Data Engineer Job at TSG Risk Management, New York, NY

eWhkcW4rck50UVBOVDBJWFNVamdRZ1VJZEE9PQ==
  • TSG Risk Management
  • New York, NY

Job Description

Location Requirement:
This is a hybrid role based in New York City. Remote work is not available - candidates must reside in or be willing to relocate to the NY area.

Responsibilities:
· Build data applications using Python, SQL, and AWS
· Build ETL pipelines for batch data ingest from APIs, databases and other sources as needed
· Apply knowledge of basic principles, methods and practices to simple and moderately complex assignments
· Proactively identify and implement opportunities to automate tasks and develop reusable frameworks
· Adhere to standard methodologies for coding, testing and designing reusable code/component
· Work as a data engineer within the Information Security team that uses several Data, Search and AWS technologies
· Implement standardized, automated operational and quality control processes to deliver accurate and timely data and reporting to meet or exceed SLAs
· Collaborate with the other engineering team members to ensure all services are reliable, maintainable, and well-integrated into existing platforms
· Review functional and technical designs to identify areas of risk and/or missing requirements
· Provide technical write-ups and drawings to promote the proposed solutions
· Partner with engineers, program managers and management to understand data needs
· Design, build and deploy efficient data pipelines to third party and internally developed systems
· Craft and build reports / dashboards using visualization tools like Tableau, Python and R

Qualifications:
· 4-5 years experience AWS cloud and AWS services such as S3 Buckets, Lambda, API Gateway, SQS queues
· 4-5 years experience with batch job scheduling and identifying data/job dependencies
· 4-5 years experience with data engineering using AWS platform and Python
· Familiar with AWS Services like EC2, S3, Redshift/Spectrum, Glue, Athena, RDS, Lambda, and API gateway
· Familiar with software DevOps CI/CD tools, such Git, Linux, and Shell Script
· Ability to learn quickly, be organized and detail oriented
· Experience in Software Engineering and Development
· Understanding of database schema design
· Proficient in Python
· Experience analyzing data to discover opportunities and address gaps
· Experience with Python, Tableau, SQL and Excel
· Experience with working in cloud or on-prem big data technologies
· Experience with data quality validation
· Looking for individuals with security driven attitude
· 4-5+ years of Python & SQL
· 4-5+ years of data modeling
· 4-5+ years of ETL design implementation and maintenance

Job Tags

Full time, Remote work, Relocation,

Similar Jobs

Venture Smarter

Full-Time General Virtual Assistant Job at Venture Smarter

**Company:** Venture Smarter**Location:** Work From Home (Remote)**Salary:** $1,500 $2,000 USD/month (depending on experience)#### *...  ...organizational and time-management abilities * Proficiency in Google Workspace (Docs, Sheets, Drive) and task management tools *... 

Heartis Fayetteville

Director Of Celebrations Job at Heartis Fayetteville

 ...operational excellence, and lifestyle personalization, Discovery Management Group plays a vital...  .... Prepares preliminary draft of Celebrations Operating Budget. Organizes and supervises...  ..., requirements for skilled nursing, assisted living and/or independent living as... 

QuickStaff

Forklift Operator Job at QuickStaff

4:00pm-1:30am. Job Details: ~6 months to 1 year Forklift experience a plus. ~ Will assist with Hoyer Lift training. ~ Printing Labels. ~ Repacking boxes and putting in correct boxes. ~ Attendance is CRUTIAL. ~ Drug test urinalysis is required as well as... 

Auto-Owners Insurance

Entry Level Word Processor Job at Auto-Owners Insurance

 ...make a new start when a loss occurs. We offer a merit-based work-from-home program based on job responsibilities. After initial training...  ...Experience High school education or its equivalent is preferred Type at least 55 words per minute with no more than 5 errors in a 5... 

Lovisa

Retail Sales Associate- Gateway Mall Job at Lovisa

Retail Sales Associate POSITION DESCRIPTION AND KEY MEASURES Department: Retail Operations Location: Store Location Report to: DM Number of direct reports: POSITION PURPOSE AND EXPECTATION: Position Summary: We're seeking an energetic and customer...