Skip to content

manarhamada564/Real-EState-Streaming

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

31 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Real Estate Data Pipeline Architecture with DataBright Scraper

Architecture Diagram


Technology Layers

  1. Data Ingestion Layer: Utilizing DataBright Scraper for gathering data.
  2. Streaming Layer: Implementing Kafka for real-time data streaming.
  3. Processing Layer: Leveraging Spark Structured Streaming for data processing.
  4. Storage Layer: Using Cassandra for scalable data storage solutions.
  5. Continuous Flow: Ensuring seamless and uninterrupted data processing

About

A scalable data pipeline using Spark, Kafka, and Cassandra for processing real estate data in real-time.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages