Data Engineer

Job Description Ready to change the way the world works? This is your chance to establish innovative new technology products, as well as your career, with the world's second largest software-maker. Hone your expertise alongside fellow talented professionals, where you'll develop some of the most exciting software solutions on the market. At IBM and The Weather Company, we're strongly committed to the advancement of open Internet standards and applications. The Weather Company (an IBM Business) is seeking a Data Engineer to utilize skills in DevOps and data management/engineering to work with architects, developers and other team members to design, build, and operationalize solutions for strategic enterprise data processing in geospatial data. Work will include development and playing a key role in the design, installation, testing and maintenance of software systems to aggressively manage the business needs for controlled structure in complex environments. Location: Yorktown Heights, NY or Littleton, MA Responsibilities: You will be a part of a distributed team participating in BigData (Hadoop,SPARK) clusters development and deployment projects with large amount of data (> 1PB) following DevOps principles (on-premise and cloud) Extend the BIG DATA line with some data formats: Parquet, ORC, Avro, Extend the Analytics line with spatial topics: Spatial Analytics, GIS, GDAL Proven experience in Agile and lean development Good technical aptitude coupled with the ability to quickly understand new technology Excellent communication, teamwork and a results-oriented attitude Proficiency in problem solving and debugging Required Technical and Professional Expertise Bachelor's degree in information technology, business, or related field, or equivalent combination of education and experience required. 10+ years data quality, data management, data/sw engineering or similar level experience required. Experience in Geospatial analytics is preferred Preferred Tech and Prof Experience DevOps & automation: Kubernetes, Git, Github, Jenkins, Terraform,Chef,Docker Experience in designing, running and troubleshooting Hadoop/SPARK clusters BIGDATA: HBase, spark, hive, elastic search Cloud: IBM Cloud, AWS, S3, Swagger Strong understanding of Linux OS core principles, performance and tuning Strong programming skills in the following languages: Python, Scala, SQL, Java, bash, c++ Experience with Analytics : SPARK, python, scala, Jupyter notebooks Strong knowledge of RDBMS management and application development: Postgres, MySQL, DB2 EO Statement IBM is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status. Preferred Education: None Commissionable: No 193765BR
Salary Range: NA
Minimum Qualification
11 - 15 years

Don't Be Fooled

The fraudster will send a check to the victim who has accepted a job. The check can be for multiple reasons such as signing bonus, supplies, etc. The victim will be instructed to deposit the check and use the money for any of these reasons and then instructed to send the remaining funds to the fraudster. The check will bounce and the victim is left responsible.

More Jobs

Core Engineering - Data Intelligence - Client ...
New York City, NY Goldman Sachs USA
Data Intelligence - Client Data Engineering - ...
New York City, NY Goldman Sachs USA
Data Engineer-XSP
New York City, NY Deloitte
Senior Data Engineer
New Hyde Park, NY Kforce
Digital Data Engineering Manager (Multiple Pos...
New York City, NY Accenture
IBD Technology - Data Engineering - Engineer
New York City, NY Goldman Sachs USA