In Summary - Big Data Specialist
Big Data Specialists typically work in the following Career Sectors:
Videos on the Web
- Big Data Specialist- from: Youtube Search
The Work - Big Data Specialist
Big data generally is defined as a collection of large datasets that cannot be analyzed with normal statistical methods. The datasets are so big, they are measured in exabytes—one quintillion (1 followed by 18 zeroes) bytes. By comparison, an mp3 song is typically less than 10 megabytes (1 followed by 6 zeroes)
The data do not have to be just numbers; they can be videos, pictures, maps, words and phrases, and so on. Examples of big data include customer reviews on commercial websites, comments on social networking websites, photos and videos posted online, electronic medical records, and bank records. There are two types of big data: structured and unstructured.
Structured data are numbers and words that can be easily categorized and analyzed. These data are generated by things like network sensors embedded in electronic devices, smartphones, and global positioning system (GPS) devices. Structured data also include things like sales figures, account balances, and transaction data.
Unstructured data include more complex information, such as customer reviews from commercial websites, photos and other multimedia, and comments on social net - working sites. These data cannot easily be separated into categories or analyzed numerically.
There are lots of occupations that work with big data in one way or another. The job tasks of these workers are evolving, as are their job titles. Several occupations that might work with big data are described below, along with their relevant job tasks.
Managers who work with big data are known as chief data officers or chief information officers. They create the policy for how their organization will use data, as well as supervise the analysts, computer programmers, and other workers.
Third Level teachers who use big data usually instruct students in statistical analysis and computer science. These teachers may have a lot of expertise and experience working with big data but choose to help new generations of workers develop their skills to enter the workforce.
Software developers have an important role in working with big data. They write the computer programs that aggregate, process, analyse, and visualize the data, along with the trends and other useful information that can be found in those data. Software developers generally are not associated with a single industry but create computer programs for use across industries for lots of different data. They may explore alternative sources of data and alter their programs to work with specific kinds.
Other emerging titles include:
Data Analyst - performs analysis of data and works out how the findings of the analysis can best be applied to profit the business. Data Analysts may have a degree such as BS in Mathematics, Economics, or Computer Science. People in this role in the business field may undertake an MBA.
Data Change Agents - drives changes in internal operations and processes based on data analytics. A Level 7 Degre in Computer Science is a typical starting point to career in this sector. A background in Six Sigma and knowledge of statistics would be beneficial.
Data Engineer/Operator - responsible for the day-to-day operation of Big Data computer systems.
Data Scientist - takes the lead in processing raw data and determines what type of analysis would deliver the best results. Draws on maths, computing, science, statistics and sociology to interpret information and produce insights. Typically has a background that includes maths and statistics, as well as artificial intelligence and natural language processing.
Data Steward - manages the quality and security of an organisation's information. A Bachelor Degree at NFQ Level 7/8 or higher and industry specific experience in the areas of IT, business, or finance would be required.
Data Virtualisation - Cloud Specialist - builds and maintains a virtualised data service layer that can draw data from any source and make it available across organisations in a consistent, easy-to-access manner. A Level 7 degree or greater in computer science or maths opens up many career opportunities across the IT sector. May have a traditional programming, database administ&
Most commonly reported Work Tasks
- Identify relationships and trends in data, as well as any factors that could affect the results of research.
- Report results of statistical analyses, including information in the form of graphs, charts, and tables.
- Analyze and interpret statistical data to identify significant differences in relationships among sources of information.
- Adapt statistical methods to solve specific problems in many fields, such as economics, biology, and engineering.
- Develop software applications or programming to use for statistical modeling and graphic analysis.
- Develop and test experimental designs, sampling techniques, and analytical methods.
- Prepare data for processing by organizing information, checking for any inaccuracies, and adjusting and weighting the raw data.
- Plan data collection methods for specific projects and determine the types and sizes of sample groups to be used.
- Process large amounts of data for statistical modeling and graphic analysis, using computers.
- Evaluate the statistical methods and procedures used to obtain data to ensure validity, applicability, efficiency, and accuracy.
Most commonly reported Work Activities
- Analyzing Data or Information Identifying the underlying principles, reasons, or facts of information by breaking down information or data into separate parts.
- Interacting With Computers Using computers and computer systems (including hardware and software) to program, write software, set up functions, enter data, or process information.
- Processing Information Compiling, coding, categorizing, calculating, tabulating, auditing, or verifying information or data.
- Interpreting the Meaning of Information for Others Translating or explaining what information means and how it can be used.
- Communicating with Supervisors, Peers, or Subordinates Providing information to supervisors, co-workers, and subordinates by telephone, in written form, e-mail, or in person.
- Making Decisions and Solving Problems Analyzing information and evaluating results to choose the best solution and solve problems.
- Getting Information Observing, receiving, and otherwise obtaining information from all relevant sources.
- Updating and Using Relevant Knowledge Keeping up-to-date technically and applying new knowledge to your job.
- Thinking Creatively Developing, designing, or creating new applications, ideas, relationships, systems, or products, including artistic contributions.
- Documenting/Recording Information Entering, transcribing, recording, storing, or maintaining information in written or electronic/magnetic form.
Interests - Big Data Specialist
This occupation is typically suited for people with the following Career Interests:
The Investigative person will usually find a particular area of science to be of interest. They are inclined toward intellectual and analytical activities and enjoy observation and theory. They may prefer thought to action, and enjoy the challenge of solving problems with sophiscticated technology. These types prefer mentally stimulating environments and often pay close attention to developments in their chosen field.
Administrative people are interested in work that offers security and a sense of being part of a larger process. They may be at their most productive under supervisors who give clear guidelines and while performing routine tasks in a methodical and reliable way.
They tend to enjoy clerical and most forms of office work, where they perform essential administrative duties. They often form the backbone of large and small organisations alike. They may enjoy being in charge of office filing systems, and using computers and other office equipment to keep things running smoothly. They usually like routine work hours and prefer comfortable indoor workplaces.
People working with Big Data need patience and enjoy the challenges of solving complex problems. In particular they need:
Problem-solving skills are important for working with big data. Analysts have to create new ways of doing things that account for the different kinds of data and the large scope of the datasets.
Communication skills - Working with big data is highly technical, but workers need to be able to clearly explain their results to other workers. And many times, those other workers may not be as data- savvy as the analysts.
Teamwork - The ability to collaborate and work well with others also is helpful in big data jobs. Work is usually spread among teams of analysts because the data are so complex. Each member of the team has a different responsibility: organizing the data, using software for analysis, or making graphics of the results, for example. It takes the entire team to complete a project.
Entry Requirements - Big Data Specialist
Pay & Salary - Big Data Specialist
Salary Range (thousands per year)* 65k - 80k
Last Updated: April, 2015
* The lower figures typically reflect starting salaries. Higher salaries are awarded to those with greater experience and responsibility. Positions in Dublin sometimes command higher salaries.
Labour Market Updates - Big Data Specialist
As with programmers, the labour market indicators examined point to an occupation in high demand with strong employment growth and evidence that employers are having difficulties filling vacancies.
National Skills Bulletin 2018
Useful Contacts - Big Data Specialist
INSIGHT - National Centre for Data Analytics
Irish Centre for High-End Computing (ICHEC)
Centre for Applied Data Analytics Research (CeADAR)