Senior Software Engineer-Business Intelligence
731 Lexington Avenue New York, NY 10065 US
Our client is a finance/technology firm that is looking for a Senior Software Engineer who will be building scalable ingestion systems which handle and prepare petabytes of data for reporting, dashboards, and advanced analytics. Join a fast-paced team of dedicated engineers who are committed to building automated, reliable, performance-oriented systems.
- You will work closely with the Management Analysis team to build solutions to help drive product usage and find new sales opportunities
- You will collaborate with cross functional teams and vendors to enhance and ingest data from internal and external sources
- You will identify opportunities to simplify and automate workflows
- You will translate business requirements into robust and scalable data pipelines for key business metrics
- You will use technologies such as Hadoop, Spark, Hive, Kafka and more
- You will be working with structured and unstructured datasets
You must have:
- 5+ years of experience with DBMS, RDBMS and ETL methodologies.
- Experience building automated, scalable architectures in an enterprise setting
- Advanced SQL capabilities are required. Knowledge of database design and experience working with extremely large data volumes is a plus.
- Programming experience in Python. PySpark and Scala is a plus.
- Strong understanding of data warehousing methodologies, ETL processing and dimensional data modeling.
- Strong problem-solving skills and trouble-shooting skills
- Knowledge of Airflow and Argo is a plus
- BA, BS, MS, PhD in Computer Science, Engineering or related technology field
- Familiarity with Hadoop ecosystem (HDFS, Spark)
- Specific expertise in implementing Informatica solutions is a plus.
- Knowledge of MPP systems
- Knowledge of streaming technologies like Kafka
- Knowledge of business intelligence reporting tools such as QlikSense, Tableau, Power BI, Cognos
Meet Your Recruiter
VP of Recruiting
As a born and raised New Yorker, it wasn’t a shock to anyone that she made her way back to the city after graduating from IU in 2012 (go Hoosiers!) A fellow camp friend referred her into the recruiting world right after graduation, and the rest, as they say, is history. When she’s not working you can find her shopping. Her claim to fame is that she was on Slime time live as a kid, and was even one of a few who was chosen to get slimmed!