IBM Jobs

Job Information

IBM Big Data Engineer in Los Angeles, California


Is data your jam? Do you think BIG Data is better data? Do you think data lakes are more fun than real lakes? Do you enjoy solving business problems with data and communicating your recommendations to others? Do you get excited about learning new tools in the Hadoop ecosystem? Do you like to travel? Are you self-motivated and like working on teams? This role might be for you!

IBM is seeking Big Data Developer with technical experience in optimizing of management and deriving insights from large, non-structured, non-relational data.

Your Role and Responsibilities

  • Design, develop, and implement batch and real time data integrationusing Big Data technologies such as Hadoop, HDFS, Hive, Spark, Flink, Sqoop, Apache Nifi, Streamsets, Impala, Kafka, NoSQL (HBase/Cassandra/MongoDB)

  • Design and develop code using one or more programming languages such as Python, Java, Shell Scripts, Scala

  • Perform component and integration testing of the code assets

  • Support code build and deploy using tools such as Maven, Gradle, SBT, GitBucket, SVN

  • Use JIRA, Confluence to collaborate, track and document development activities

  • Participate in all aspects of the software life cycle, including analysis, design, development, unit testing, production deployment and support.

  • Formulate approaches and gather data to solve technical problems, develop conclusions and present solutions through formal deliverables.

  • Create Big Data accelerators to help deploy scalable solutions fast

You will be successful in this role if you enjoy problem solving and utilizing consulting skills. Team leadership experience is preferred.

In this dynamic role, you will have the opportunity to interact directly with clients. As such, travel to client sites may be required, up to 4 days per week. Preferred candidates will reside within a 50 mile radius of a major airport.


Required Technical and Professional Expertise

  • Minimum 5 years of programming experience in core Java, Python and Unix scripting

  • Minimum 2 year of experience in Apache Kafka

  • Minimum 2 year of experience in Hadoop, HDFS, Sqoop and Hive

  • Minimum 2 year of experience in HBase or Cassandra or MongoDB

  • Minimum 2 year of experience in programming using Spark and Spark Streaming

  • Minimum 2 years of working experience on Agile & Scrum methods

Preferred Technical and Professional Expertise

  • Exposure to Application and Data integration using REST or Thrift or JMS

  • Exposure to search/index technologies such as ElasticSearch or Solr

  • Experience on continuous build and integration using tools such as Gradle and Jenkins

  • Experience in performance monitoring tools such as DynaTrace and Splunk

  • Experience in REST API and JMS and WebServices and MQ

  • Experience in JUnit and JMeter and MRUnit or other testing tools

  • Knowledge of Docker and MicroServices

  • Knowledge of Domain driven design

About Business Unit

IBM Services is a team of business, strategy and technology consultants that design, build, and run foundational systems and services that is the backbone of the world's economy. IBM Services partners with the world's leading companies in over 170 countries to build smarter businesses by reimagining and reinventing through technology, with its outcome-focused methodologies, industry-leading portfolio and world class research and operations expertise leading to results-driven innovation and enduring excellence.

Your Life @ IBM

What matters to you when you’re looking for your next career challenge?

Maybe you want to get involved in work that really changes the world? What about somewhere with incredible and diverse career and development opportunities – where you can truly discover your passion? Are you looking for a culture of openness, collaboration and trust – where everyone has a voice? What about all of these? If so, then IBM could be your next career challenge. Join us, not to do something better, but to attempt things you never thought possible.

Impact. Inclusion. Infinite Experiences. Do your best work ever.

About IBM

IBM’s greatest invention is the IBMer. We believe that progress is made through progressive thinking, progressive leadership, progressive policy and progressive action. IBMers believe that the application of intelligence, reason and science can improve business, society and the human condition. Restlessly reinventing since 1911, we are the largest technology and consulting employer in the world, with more than 380,000 IBMers serving clients in 170 countries.

Location Statement

For additional information about location requirements, please discuss with the recruiter following submission of your application.

Being You @ IBM

IBM is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.