Data engineering for the European power system.
I'm Luis Jimenez Rubia, an independent data engineer based in Brussels. I build and run the pipelines that turn grid and market data – capacity calculation results, ENTSO-E and JAO files, regulatory KPIs – into numbers people can trust.
A day on the European grid
96 quarter-hour market time units. This is the day most code is written for.
Getting days like these right, every time, is most of the job.
What I do
Energy data
- Regulatory and KPI reporting
- CACM and IDCC KPIs, monthly data quality indicators and the reports built on them, with figures you can trace back to the source file.
- Grid and market data pipelines
- Ingesting ENTSO-E, JAO and TSO files over SFTP and APIs, with time zones, clock changes and late or corrected files handled on purpose.
- Lakehouse and medallion architecture
- Bronze, silver and gold layers on PostgreSQL or Delta Lake, including migrations away from a legacy warehouse without breaking the reports that depend on it.
Platform and delivery
- dbt and Apache Airflow
- Models, tests and DAGs your team can maintain after I leave. Code review and coaching for junior engineers.
- PostgreSQL performance
- Slow queries, materialized view refreshes, disk and vacuum problems, monitoring that warns you before users do.
- Analysis and project management
- Turning a regulation or a business need into a specification, a plan and a delivered pipeline.
Experience
More than 30 years in IT since 1996: data engineering, database administration, business analysis and project management.
- A Regional Coordination Centre serving European transmission system operators
- A European financial market infrastructure
- Directorates-General of the European Commission
- Energy, telecoms, airline, automotive and public sector companies in Spain
Tools I use every day
dbt, Apache Airflow, PostgreSQL, Python, Delta Lake, MinIO, Git, Oracle PL/SQL, Power BI
How we work together
A short call
You explain the problem; I tell you honestly whether I'm the right person for it.
A written proposal
Scope, deliverables, timeline and price on one page.
Delivery
In your repositories and your environments, on site in Brussels or remote, with regular check-ins.
Handover
Documentation and a walkthrough, so your team owns what was built.
Get in touch
info@magicbyte.euThe fastest way to reach me is email. I work in English, French and Spanish.
Brussels, Belgium