This project provides real-time log streaming, analysis, and anomaly detection using Spring Boot, Apache Kafka, Spark Streaming, and Machine Learning.

• Spring Boot Kafka Producer & Consumer
• REST API for Log Ingestion
• Spark Streaming for Log Analysis
• Anomaly Detection using ML
• Alerting via Slack
• Visualization with Grafana/Kibana

bin/zookeeper-server-start.sh config/zookeeper.properties
bin/kafka-server-start.sh config/server.properties
bin/kafka-topics.sh --create --topic logs-stream --bootstrap-server localhost:9092 --partitions 1 --replication-factor 1

mvn clean package
java -jar target/RealTimeLogAnalysis.jar

curl -X POST "http://localhost:8080/logs/send?message=High CPU Usage Detected"

• Connect Kafka to Spark Streaming for advanced log processing.

• Grafana: Add MongoDB as a data source and visualize logs.
• Kibana: Use Elasticsearch for real-time monitoring.

• Add SMS alerts via Twilio
• Implement deep learning for anomaly detection
• Improve log classification models