Project I worked on for about 5 months as an intern at Fulcrum-GT. The intent was to create a tool which allowed for easy ETL configuration without the need for any coding knowledge so that our config teams could rely less on engineers for new client setup. Made entirely by myself and another intern.
https://youtu.be/kYUPLb1SRlc
Features
- Type Safety: will check that transformation chains have compatible types from start to finish based on declared schema.
- Transform Library: implemented a variety of transforms.
- Mappings from a variety of sources: perform mappings based on database queries, etc.
- Performance: Leverage Electron's IPC to run transformations on a separate process running in a Node environment which allowed for easy file IO.