大数据日志分析基础

  • February 2016 Talk: Presented a new talk at OOP in Munich on "Comparison of Frameworks and Tools for Big Data Log Analytics and IT Operations Analytics", focusing on different solutions for analyzing big masses of distributed log events with the emerging Microservices architecture concept.
  • Key Take-Aways: Log Analytics enables IT Operations Analytics for Machine Data; correlation of events is key for added business value; Log Management is complementary to other Big Data Components.
  • Log Management: A mature concept for many years used for troubleshooting, root cause analysis, and security issues. Compares different log management solutions like SaaS Cloud (Papertrail, Loggly, Sumo Logic), Open Source Frameworks (ELK stack, Graylog), and Enterprise Products (TIBCO LogLogic, IBM QRadar, Splunk).
  • IT Operations Analytics (ITOA) with TIBCO Unity: A new and growing market that focuses on making complex correlations of distributed data for predictive analytics in real time. TIBCO Unity can integrate log data and real-time events to enable monitoring and analysis of distributed Microservices.
  • Apache Hadoop versus Log Management and ITOA: While Hadoop can store and analyze data, Log Management and ITOA tools offer an integrated solution with built-in data indexing, processing, and visualization. But a better Hadoop integration is possible and using both together may make sense for very big data.
  • Slides: Shared the slide deck on "Framework and Product Comparison for Big Data Log Analytics and ITOA" from Kai Wähner, which can be viewed in an embedded iframe. Appreciates questions or feedback.
阅读 12
0 条评论