| | |
| | |
Stat |
Members: 3643 Articles: 2'487'895 Articles rated: 2609
28 March 2024 |
|
| | | |
|
Article forum
| |
|
A Big Data Architecture for Log Data Storage and Analysis | Swapneel Mehta
; Prasanth Kothuri
; Daniel Lanza Garcia
; | Date: |
1 Dec 2018 | Abstract: | We propose an architecture for analysing database connection logs across
different instances of databases within an intranet comprising over 10,000
users and associated devices. Our system uses Flume agents to send
notifications to a Hadoop Distributed File System for long-term storage and
ElasticSearch and Kibana for short-term visualisation, effectively creating a
data lake for the extraction of log data. We adopt machine learning models with
an ensemble of approaches to filter and process the indicators within the data
and aim to predict anomalies or outliers using feature vectors built from this
log data. | Source: | arXiv, 1812.0111 | Services: | Forum | Review | PDF | Favorites |
|
|
No message found in this article forum.
You have a question or message about this article?
Ask the community and write a message in the forum.
If you want to rate this article, please use the review section..
To add a message in the forum, you need to login or register first. (free): registration page
|
| |
|
|
|
| News, job offers and information for researchers and scientists:
| |