RESTful service to ingest large OHLC CSV files into PostgreSQL and query them with pagination.
POST /data: upload & process CSV (UNIX,SYMBOL,OPEN,HIGH,LOW,CLOSE)GET /data: query with pagination & filters (symbol,unix_from,unix_to)- JSON responses only
- Runs in Docker
- Migrations included
This assignment required a high-performance ingestion engine capable of processing extremely large CSV files (up to ~1 TB). I chose Golang because it provides lightweight concurrency with goroutines, a modern and efficient garbage collector, and fast I/O performance. Go also supports streaming millions of rows directly into PostgreSQL using COPY IN, enabling bulk ingestion that is significantly faster and more memory-efficient than traditional ORM-based approaches.