GitHub - rhysc25/RealTimeDataPipeline: A data pipeline using Kafka and Spark to publish and process market pricing data, and making use of a Postgresql database. Containerised with docker, and deployed onto AWS (EC2, RDS, S3).

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 18 Commits
__pycache__		__pycache__
consumer		consumer
producer		producer
.gitignore		.gitignore
APIKeys_template.py		APIKeys_template.py
docker-compose.yaml		docker-compose.yaml

About

A data pipeline using Kafka and Spark to publish and process market pricing data, and making use of a Postgresql database. Containerised with docker, and deployed onto AWS (EC2, RDS, S3).