Paving the way from Data Chaos to Data Confidence
Welcome to The Data Conundrum! — a blog dedicated to exploring the evolving world of DataOps, Data Quality Engineering, and automated frameworks that enable scalable, resilient, and high-trust data systems.
Created and maintained by Sneha Shrivastav, a seasoned IT professional with nearly decades of experience helping global investment banking clients solve complex data quality challenges.
This blog shares practical insights, frameworks, and real-world experiences on:
- Designing and implementing automated data quality checks
- Leveraging DataOps principles in modern data teams
- Exploring tools like Great Expectations, dbt, Airflow, Spark
- Ensuring trust in data with robust testing and observability
- Commentary on how AI is reshaping the data engineering space
Whether you're a data engineer, architect, or just someone trying to make sense of the data mess — this space is for you.
This blog is built using the Chirpy Jekyll Theme and hosted on GitHub Pages.
To run it locally:
git clone https://github.com/sneha-dq/sneha-dq.github.io.git
cd sneha-dq.github.io
bundle install
bundle exec jekyll s- 📫 Blog: https://sneha-dq.github.io
- 📚 Featured post: Modern Data Warfare: Win with DataOps & Automated DQ Frameworks
This project is open source and available under the MIT License.