IBM Big Data Engineer in Minneapolis, Minnesota

Job Description

Overview

We live in a moment of remarkable change and opportunity. The convergence of data and technology is transforming industries, society and even the workplace—by creating professions that didn’t exist before the emergence of data, cloud, social and mobile. IBM Global Business Services is a leader in this worldwide transformation and just the place to define and develop your consulting career. Whether it’s business consulting, sales, project management or a technical path, you’ll have the opportunity to make an impact on the world by working to solve some of society’s most complex problems with your original thinking and ideas. As an IBMer, you’ll innovate in pursuit of higher value in everything you do, all while being guided by IBM’s purpose—to be essential. Essential in your leadership and dedication to building valuable client relationships with groundbreaking work. Essential in uncovering what’s possible and helping global clients succeed. Join us as we make the most of these exciting times and discover what you can make of this moment. What will you make with IBM?

Description

Do you want to be part of a cutting-edge solutions team that bring together IoT/data? Would you like to join a team focused on increasing client satisfaction by delivery results working with high performing team members. As a Big Data Engineer; you will be responsible to design and develop multiple big data utilities that automate various aspects of data acquisition, ingestion, storage, access and transformation of data volume that scale up to petabytes. You will be part of a high octane, multi-disciplinary team working on Data Acquisition, Ingestion, Curation, Storage teams, etc. You will be a hands-on developer partnering with team leads, technical leads, solution architects and data architects

Responsibilities

  • Lead a multi-disciplinary technical team

  • Lead fast moving development teams using Agile Methods

  • Design and build data services to auto create Hive structures, HDFS directory structures and partitions based on source definitions using a configuration and metadata driven framework.

  • Design and create big data solutions using industry standard opensource technologies

  • Serve as a Though leader and 'Go-To' individual for core big data technologies including but not limited to Hadoop, Big Insights , Hortonworks, Cloudera, Hadoop Common, Concurrency and Opensource DBs

  • Demonstrate strong implementation skills on tight schedules with aptitude to translate business and technical requirements into a scalable solution to meet customer end state business needs

  • Acumen to communicate both business and technical results/issues/road blocks in a clear and concise form to senior executives.

  • Proven commitment to personal and team professional development at client and IBM

CPT18

Required Technical and Professional Expertise

  • 10+ years of Java development experience

  • 4+ years of coding experience with Java, MapReduce, Pig and Python

  • 5+ years of deep working knowledge in use of open source tools; HBase, Hive, Sqoop, etc.

  • 8+ years of experiences and thorough understanding of Linux scripting

  • 6+ years of coding experience with SQL & Linux Bash/Shell Scripting

  • 2+ large scale implementations as a technical lead with deep hand-on experience

  • 4+ years Big Data implementation, Data Lake development, Business Intelligence and data warehousing development techniques

  • 2+ years expertise in concepts like Apache Spark and Scala

  • 3+ years hands on experience in Hadoop ecosystem and Hadoop Common

  • Ability to convert hard-to-grasp technical requirements into extraordinary designs

  • Experience designing web services for swift data tracking and querying data at high speeds

  • Experience testing software prototypes, proposing standards and transferring them to operations

  • Writing high-performance, reliable and maintainable code

Preferred Tech and Prof Experience

  • Experience or knowledge with the following: Big Data Architecture, Data Sciences, Hadoop, Hadoop Admin etc., SPARK, Kafka, Flume, MYSQL, NoSQL, Cassandra, Neo4J, MongoDB, Hortonworks, Big Insights, Cloudera Good knowledge of database structures, theories, principles, and practices

  • Ability to write MapReduce jobs

EO Statement

IBM is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.