Customer story

Strengthening national security with real-time threat detection at scale

Background

Safeguarding nations amidst an ever-changing threat landscape

With cyberattacks becoming increasingly complex and sophisticated, a proactive, data-driven, approach is required to identify risks and mitigate threats before they escalate. To help a law enforcement agency achieve this, ClearTrail Technologies—a leading provider of intelligence and investigation technologies—partnered with Gathr.ai.

Business Goals

Detect suspicious user activities across the web with geolocation, in real time.

ClearTrail was looking for a solution that would help detect threats in real time and enable their client, a law enforcement agency, to prevent illegal activities with early intervention. They wanted to:

Identify suspicious online activity by analyzing billions of internet and social media events
Detect concerning behavioral patterns along with each user’s geolocation
Perform fast searches on historical records and retrieve insights within seconds
Seamlessly process and store massive volumes of data (~120 TB/day)
Minimize infrastructure and operational costs while maximizing performance and scalability
Challenges

Legacy systems were failing to deliver the scale and speed needed for real-time threat detection

Difficulty in managing multiple, high-volume streaming feeds

As web environments generate massive amounts of traffic every second, the law enforcement agency needed to seamlessly analyze multiple real-time feeds. This required a solution with advanced capabilities for ingestion, ETL, data processing, and analytics.

Inability to eliminate irrelevant data in early stages

Given the scale of the task at hand, there was a pressing need to filter out irrelevant data upfront and organize all the necessary data efficiently. The client wanted a scalable solution that delivered high throughput while indexing and storing data efficiently.

Lengthy development cycles

Outdated data practices and ETL systems were hindering real-time threat detection and causing performance bottlenecks. Moreover, the existing processes for debugging and rectification were cumbersome and time-consuming.

High infrastructure and operational costs

Inefficiencies in the existing data processing system were driving up operational and infrastructure costs.​ The need of the hour was to save valuable engineering hours and reduce time to production.

How Gathr.ai helped

Delivered real-time threat intelligence at scale with a low-code, high-performance data processing solution

Low-latency data processing and analysis

Powered real-time data ingestion and analysis, processing 1.5 million events per second with stateful, complex rule-based detection.

​Low-code/no-code pipeline building

Gathr.ai’s visual logic application development capabilities helped reduce engineering effort, accelerating the orchestration of 30 high-performance pipelines.

Storage optimization 

Filtered out irrelevant data upfront to accelerate data processing and deliver more accurate insights.

Real-time monitoring and alerts 

Enabled faster search and real-time alerts, helping the law enforcement agency respond to suspicious user behavior immediately. 

data-pipelining-threat-intelligence-using-gathr-ai
Business Impact

Gathr.ai and ClearTrail Technologies helped the law enforcement agency mitigate dangerous attacks while driving massive cost, productivity and performance benefits.

1.5 M

events processed/ second

90x

increase in data processing capacity​

50%

lower development costs

20x

less infrastructure cost

3x

faster time to production

Gathr.ai helped us seamlessly analyze billions of internet events in real-time. This in turn enabled the law enforcement agency to mitigate dangerous attacks and strengthen national security.

Manohar Katoch

Senior Vice President – Sales, ClearTrail Technologies

Manohar Katoch

Senior Vice President – Sales, ClearTrail Technologies

Gathr.ai helped us seamlessly analyze billions of internet events in real-time. This in turn enabled the law enforcement agency to mitigate dangerous attacks and strengthen national security.