Business intelligence
Learning outcome statements
The learning outcome statements relevant for this section are:
- define Big Data and explain the volume, velocity, variety, and veracity of Big Data; and describe the opportunities and challenges of leveraging insight from this data
- explain how structured, semi-structured, and unstructured data is used by a business enterprise
- describe the progression of data, from data to information to knowledge to insight to action
- describe the opportunities and challenges of managing data analytics
- explain why data and data science capability are strategic assets
- define business intelligence (BI) (i.e., the collection of applications, tools, and best practices that transform data into actionable information in order to make better decisions and optimize performance)
Introduction to data analytics
Businesses use data analytics to optimize operations, enhance customer experiences, and drive strategic initiatives.
Big Data plays a fundamental role in data analytics by serving as the foundation for extracting valuable insights. The vast volume, high velocity, and diverse variety of data generated daily provide the raw material for analytics. Data analytics tools process Big Data to identify trends, predict outcomes, and make data-driven decisions. Without Big Data, organizations would have limited datasets, reducing the effectiveness of analytics in detecting meaningful patterns and generating actionable insights.
Definition of Big Data
Big Data is characterized by four "V"s:
- Volume: The sheer amount of data generated daily, requiring scalable storage and processing solutions.
- Velocity: The speed at which data is created, processed, and analyzed, often in real-time or near real-time.
- Veracity: The reliability and accuracy of data, which can vary due to inconsistencies, duplications, or biases.
- Variety: The different types of data, including structured (databases), semi-structured (JSON, XML), and unstructured (videos, emails, social media posts).
Opportunities of leveraging from Big Data
Leveraging Big Data provides opportunities for businesses, including:
Challenges of leveraging from Big Data
Businesses also face challenges in utilizing Big Data:
Structured, semi-structured, and unstructured Data
Organizations handle different types of data that influence operations and decision-making:
- Structured Data: Organized and stored in relational and non-relational databases (e.g., sales records, financial transactions, customer profiles). Structured data is the traditional form of data that businesses have managed for decades, using conventional tools such as SQL for extraction and analysis. Businesses use structured data for reporting, trend analysis, performance tracking, and regulatory compliance, ensuring accurate and standardized information for audits and financial reporting. For example, banks store transaction details in structured databases to monitor account activity and detect fraudulent transactions.
- Semi-Structured Data: Contains tags and metadata but does not conform to rigid database structures. It helps businesses integrate different systems and analyze flexible data formats, such as extracting key details from emails, processing transaction logs, and organizing IoT-generated sensor readings for predictive maintenance. A real-world example is email archiving, where metadata such as timestamps and sender details are used for compliance tracking and analysis.
- Unstructured Data: Does not have a predefined format (e.g., images, videos, social media posts). Companies use unstructured data for customer sentiment analysis, AI-driven automation, and media content management. For instance, retail companies analyze customer reviews and social media discussions to assess brand perception and improve product offerings.
By leveraging all types of data, enterprises can gain deeper insights, enhance decision-making, and drive business innovation.
