Roles in Big Data Revealed
In This Chapter
▶ Understanding different big data roles
▶ Examining real-world examples of requirements ▶ Seeing how job requirements translate to work life ▶ Doing a skills and interest assessment for each role
T
hey say that when someone is training to spot counterfeit currency, the would-be crime fighter examines the real thing with more intensity than the fraud. That’s where examining real-world big data case studies comes in handy. In this chapter, I examine both the theory and the practical knowledge to help you craft your interview story and land that perfect job. I give you a look at different roles in big data along with real-life job posting case studies and interest assessments that help you gauge your interest in a particular big data field.Big data is a tool. There are many dimensions to the roles available in big data. In this chapter, we’ll build a foundation of different roles from a business and technical perspective.
Big Data Jobs for Business Analysts
Big data projects originate with solving problems with some business objec- tive in mind. Much of the focus today centers around technology implementa- tion, visualization tools, and data products, but it’s important to remember that technology with no end in mind has little business value. Enter the role of the business analyst. Some people claim that this career is an endangered species, but there is some very good news for business analysts. Big data isn’t just a new technology. It’s changing the face of how we do business, and that means that the business analyst’s role in big data is extremely important. It has been expanded to include that of business architect.
50
Part II: Getting Your Big Data Education
The basis for any of the roles discussed in this chapter often comes from the vision cast by business analysts. If you can envision a bridge that spans the gap between business and technology, you may find great suc- cess in this type of role. A business analyst can serve within a corporate IT division, a software firm specializing in big data, or a consulting firm. (See Chapters 8 and 10 for more information on life within these types of organizations.)
Some more good news, by the way: A recent Robert Half salary report shows the average salary for a business analyst is between $75,000 and $109,000, up more than 4 percent from 2013. Business intelligence analysts are seeing an even greater increase in starting salaries from 2013, with an increase of more than 7 percent. The market is demanding more analysts, and it’s paying for it.
Besides the official title of business analyst, other possible job titles include marketing analyst, data analyst, and system analyst. (The term data analyst
can also be confused with the data scientist’s role, as I explore later in this chapter.)
Assessing your interest
In this section, I fill you in on some attributes you should consider as you evaluate your skills and interests. Spend some time reflecting on these areas. Do the skills self-assessment in Chapter 2. Talk to trusted advisors and get their perspective on you. Look back at your reviews from previous jobs or class reviews if you’re still a student.
If you answer “yes” to many of the following questions, the business analyst role could be for you. Keep in mind, this is not an all-or-nothing guide. If you answer “no” or “not really” to a question, that doesn’t mean you should rule out a role as a business analyst.
Are you naturally inquisitive?
The best approach to big data analytics is to come at business problems with the question/hypothesis perspective. Business analysts need the industry expertise (or ability to collaborate with industry experts) to identify the most relevant and most valuable questions to explore.
Can you see beyond the surface issues and go deeper into the problem? Do you know when a good idea has potential? Business analysts are skilled at sticking with a problem until they’ve found a solution. If you can drive hard and get to an answer, this could be great role for you.
51
Chapter 4: Roles in Big Data Revealed
Can you see through to the end quickly?
A friend of mine who is a lieutenant commander in the U.S. Navy often says he looks to develop an important trait in junior officers. He’ll tell them, “Know the right answer when you hear it.” In other words, do you know when you’ve uncovered the right area to focus on, and do you pivot quickly to focus your energies on solving that problem?
One of the biggest challenges in big data is that there is way too much data — not too little. Business analysts who can quickly see what is just a dis- traction and what needs focus are very effective.
Can you shift between creative and analytical?
I sometimes think of big data analysis in terms of an alternate blend of left- brain and right-brain activities. Creativity, curiosity, and imagination are all needed, as well as logic and rational and critical thinking. This is perhaps the rarest attribute. People tend to have a bias toward either creativity or logic, but the well-balanced analyst has the ability to see things at a abstract level and then to quickly go deep into the issue. Can you build a presentation for an executive to explain an idea and then write a four-page detailed document to explain the economics, technology, or implementation strategy? If so, you might make a successful business analyst.
Do you understand your audience?
One of the biggest opportunity areas I see right now is the improvement of how information is communicated to decision makers. Business analysts who can convert data into business opportunities and recommend action will rise to the top. There is absolutely no business value in data unless it translates to action.
Can you talk technology with the CTO and also explain the financial benefits of big data to the CFO? Can you help the marketing manager see the impact to her business unit? A good big data business analyst doesn’t just under- stand big data technology and how it works; he also understands the impact to business and can speak the language of business.
Business analysts need to have people skills, as well as communication skills. They need to like to work collaboratively and make presentations on and off the white board. They also need to write, document, and negotiate.
Looking at a job posting
The job postings for business analysts vary based on the type of company — whether it’s a consulting firm, a big data software firm, or an internal big data team for a corporation. These postings tend to be less specific in
52
Part II: Getting Your Big Data Education
responsibilities and focus on solving business problems, good communi- cation skills, and a balance of analytical ability and technology. You often see requirements for familiarity with Microsoft Excel, analytics tools, and database technologies. Largely though, the analytical skills are focused on problem-solving frameworks rather than database programming. A problem- solving framework follows a pattern for solving problems and executing on the solution. You need to be able to quickly identify the problem or need, find a solution, make recommendations, identify risks and how to avoid them, and describe what the action plan should be.
Consider the following job posting for an analyst with a big data focus. Carnegie Mellon University has published samples of business intelligence roles that recent employers have used. The following posting is for a busi- ness intelligence analyst, taken from Carnegie Mellon.
Business Intelligence Analyst
Each Business Intelligence Analyst is aligned with one or more groups, such as marketing, logistics, or customer service, and partners with those teams to help them achieve their goals. Whether you’re measuring site performance, analyzing customer behavior and trends, data mining, or optimizing SQL queries, you’ll be working with cutting-edge technology and multi-terabyte datasets. Working on the Business Intelligence team is a premier opportunity to develop a career in business and big data analytics.
At their core, Business Intelligence Analysts are strong in quantitative analysis. They enjoy coding but also want to balance that with their inter- est in business. They think critically to tackle complex challenges, thrive in a fast-paced environment, and are seeking a high-growth opportunity where they’ll have an immediate impact on day one. Business Analysts are strong communicators who are eager to learn, are endlessly curious, take pride in hard work, and are committed to rapidly advancing their career.
Responsibilities include:
• Consulting with internal customers (for example, marketing, logis- tics, or customer service) to develop analyses that lead to action- able insights that accelerate profitable growth
• Wrangling data from multiple sources including sales, inventory, product, and customer databases to create integrated views that can be used to drive decision making
• Working with several large and complex SQL databases • Designing and building reports and analyses in Microsoft Excel
53
Chapter 4: Roles in Big Data Revealed
Qualifications include:
• Highly analytical data junkie who enjoys coding but doesn’t want to be a software engineer
• Positive, people-oriented, and has an energetic attitude
• Analytical, creative, and employs an innovative approach to solv- ing problems
• Strong written and verbal communication skills • Entrepreneurial spirit
• Degrees represented on current Business Analyst team include: Economics, Computer Science, Engineering, Physics, and Music There are a few things worth calling out in this posting that can help you decide if this role is for you. In the list of responsibilities, the positing says, “Consulting with internal customers (for example, marketing, logistics, or customer service) to develop analyses that lead to actionable insights that accelerate profitable growth.” What does that mean really? Analysts don’t just have to understand information; they need to be able to articulate an action plan so that the business can capitalize on those insights. This is not merely a role that notices interesting things. This individual is expected to draw conclusions and drive action to revenue.
Case studies: Learning from the real thing
Examining real-world case studies from themarketplace is important for several reasons: ✓ Looking at the real thing helps you hone
your skills and target the kind of role you want . The scenarios found in this chapter may not apply to the industry you’re cur- rently in, but they allow you to understand what may be possible in your industry. ✓ It allows you to map your journey as you
go . If you can understand what roles your interests and skills fall into, the next step is to study the requirements of those func- tions and see how that plays out in the
marketplace. By examining a potential nar- rative, you can create your own story. You may notice that the specific company names aren’t mentioned. That doesn’t mean these case studies were pulled out of thin air. Often, when an organization wants to highlight its capability to deliver on a particular solution, the client isn’t willing to disclose its name. It could be for competitive reasons. Rest assured that these case studies are based on real life, so you can believe them to be true even if the names have been changed (or removed in this case) to protect the innocent.
54
Part II: Getting Your Big Data Education
This role is technical, but you aren’t expected to do heavy programming. Should you be able to code? Yes, but you probably won’t be doing much of that. That’s important for those who build those virtual bridges between business and technology — they need to be able to understand the com- ponents of big data solutions like appropriate technologies, software, or hardware needed to fulfill the business requirements. If the technology team has selected one programming language or model over another, the business analyst needs to be able to understand why that’s a good or bad decision and how that could impact the overall outcome.
Finally, check out the kinds of majors that fall into this role — pretty much everything. Employers are looking for problem solvers who can find creative solutions and have the bias for action to drive real results.
Big Data Jobs for Data Scientists
Data scientists take the recommendations that the business analysts make and do a variety of tasks including the following:
✓ Build the technical case. They apply advanced math and statics to build the technical cases around the hypotheses that the business analysts build. Data scientists are tasked with building the models required to test these theories. This model is important to big data. You start with a hypothesis. For example, if we change the branding colors on a product on a given day and publish that on Twitter and it is positively received, we can expect an increase in sales of 4 percent. That is the hypothesis.
✓ Create the mathematical models. These models measure what positive
sentiment means and then can model what tests need to be run to find correlations between that and price increases.
✓ Discover patterns, trends, and correlations. Some tasks may not neces- sarily start with a hypothesis. This is where the real power of big data comes in. You find patterns and trends you didn’t even know existed. The skill required here is to take a business idea and model it with numbers and data. Data scientists take that data and turn it into information. There can be a fine line between what data scientists do and what computer scien- tists do. There are some overlaps, but there are also jobs with a significant difference, namely in scientific and academic research.
Assessing your interest
As with the business analysts, there are a set of questions you can ask your- self to see if you’re a fit for this type of job. Roles as a pure data scientist often require a master’s degree or a PhD. So, you should carefully consider the following questions.
55
Chapter 4: Roles in Big Data Revealed
Are you naturally inquisitive?
Just as a business analyst needs to think in terms of building hypotheses, the data scientist needs to have aptitude in this area. Computer scientists need to be able to construct models that can prove or disprove a given business hypothesis. Can you see beyond the surface issues and go deep? Do you know when a result has potential and needs further testing? Are you passion- ate about technology?
Can you focus for a long time?
The journey required to complete a PhD or advanced degree in the big data field (see Chapter 5) can be a long one. You have to commit a significant amount of study to a specific area of research. Are there areas of math, sta- tistics, or computer science that you have a passion for studying? Do you want to address big problems that may take years to solve? Do you like to write . . . a lot? Can you maintain intense focus on a few topics for many years — maybe for an entire career?
Are you self-motivated?
Data scientists need to be able to direct their own intellectual paths. Do you naturally follow a solution to its end? Do you have a knack for knowing where to find answers if you don’t know them?
Are you multidisciplined?
Data scientists need to be knowledgeable in multiple areas — math, statistics, and computer science. Can you pick up computer science languages and con- cepts easily? Does the idea of a new language excite you or intimidate you? Can you easily collaborate with others to learn new things?
Idea to reality
Data modeling requires the ability to take business concepts and ideas and model those within a world driven by numbers and data concepts. Do you have the aptitude or interest to build experiments that capture the business value?
Looking at a job posting
Let’s take a look at job posting for a data scientist who would operate at a junior level, or someone who has less than five years experience. The first posting is for an entry-level consultant, and the second would be more aligned with an academic or research-oriented position and was actually posted on several job search websites such as Indeed and SimplyHired. Both are grounded in math and statistics.
56
Part II: Getting Your Big Data Education
Data Consultant — Recent College Grad
Are you a recent college graduate who loves big data? Are you passion- ate about cutting-edge technologies and solving challenges for Fortune 500 clients? As a consultant, you’ll be part of a team that develops and implements advanced algorithms and data pipelines that extract, classify, merge, and deliver new insights and business value out of structured and unstructured data sets. You’ll work on a team whose data science efforts range from exploration and investigation to design and development of analytic systems. You’ll have a chance to gain diverse experience across multiple technologies and create path-breaking solutions. You’ll be sur- rounded and learn from the foremost Thought Leaders in the big data space.
This posting describes two paths: Data engineering and data science. Key responsibilities include:
Data engineering
• Designing and developing code, scripts, and data pipelines that leverage structured and unstructured data integrated from mul- tiple sources
• Software installation and configuration
• Participating in requirements and design workshops with our clients
• Developing project deliverable documentation
Data science
• Providing big data solutions for our clients, including analytical consulting, statistical modeling, and quantitative solutions
• Mentoring sophisticated organizations on large-scale data and ana- lytics and working closely with client teams to deliver results • Helping to translate business cases to clear research projects, be
they exploratory or confirmatory, to help our clients utilize data to drive their businesses
• Collaborating and communicating across geographically distrib- uted teams and with external clients
Required skills/experience include:
Data engineering
• BS or MS in Computer Science or equivalent work experience • Experience programming in Java, Python, SQL, or C/C++
• Background that includes mathematics, statistics, machine learn-