Business intelligence
Learning outcome statements
The learning outcome statements relevant for this section are:
- define big data and explain the volume, velocity, variety, and veracity of big data; and describe the opportunities and challenges of leveraging insight from this data
- explain how structured, semi-structured, and unstructured data is used by a business enterprise
- describe the progression of data, from data to information to knowledge to insight to action
- describe the opportunities and challenges of managing data analytics
- explain why data and data science capability are strategic assets
- define business intelligence (BI) (i.e., the collection of applications, tools, and best practices that transform data into actionable information in order to make better decisions and optimize performance)
LOS 3-6 (the data-to-action progression, managing data analytics, data as a strategic asset, and the definition of business intelligence) are covered in the next chapter, From data to Business Intelligence.
Introduction to data analytics
Businesses use data analytics to optimize operations, enhance customer experiences, and drive strategic initiatives.
Big data plays a fundamental role in data analytics by serving as the foundation for extracting valuable insights. The vast volume, high velocity, and diverse variety of data generated daily provide the raw material for analytics. Data analytics tools process big data to identify trends, predict outcomes, and make data-driven decisions. Without big data, organizations would have limited datasets, reducing the effectiveness of analytics in detecting meaningful patterns and generating actionable insights.
Definition of big data
Big data is characterized by four "V"s:
- Volume: The sheer amount of data generated daily, requiring scalable storage and processing solutions.
- Velocity: The speed at which data is created, processed, and analyzed, often in real-time or near real-time.
- Veracity: The reliability and accuracy of data, which can vary due to inconsistencies, duplications, or biases.
- Variety: The different types of data, including structured (databases), semi-structured (JSON, XML), and unstructured (videos, images, social media posts).
Opportunities of leveraging from big data
Leveraging big data provides opportunities for businesses, including:
- Enhanced decision-making: analyzing historical and real-time data supports informed, data-driven decisions instead of guesswork - for example, a financial institution using predictive analytics to assess loan default risk.
- Improved customer insights: analyzing purchasing patterns and feedback helps businesses personalize marketing and improve products - for example, an e-commerce platform recommending products based on past purchases.
- Operational efficiency: analyzing sensor and workflow data helps businesses automate processes and catch inefficiencies - for example, predicting equipment failures before they cause downtime.
- Innovation and competitive advantage: predictive analytics and AI help businesses develop new products and services - for example, AI-powered diagnostic tools that analyze medical imaging to enable early disease detection.
Challenges of leveraging from big data
Businesses also face challenges in utilizing big data:
- Data storage and processing costs: managing large datasets requires significant infrastructure investment, since storing and processing high volumes of data demands high-performance computing and cloud storage that can become costly as data grows.
- Data security and privacy risks: sensitive data must be protected from breaches and unauthorized access, through measures such as encryption and compliance with data protection regulations.
- Data integration complexity: combining data from multiple sources, such as CRM systems, social media, and IoT devices, requires advanced data management tools to unify and process it efficiently.
- Skilled workforce requirement: extracting meaningful insights requires data scientists and analysts trained in data science, machine learning, and analytics tools.
- Data quality (veracity): inaccurate, inconsistent, duplicated, or biased data can lead to misleading conclusions, so data must be validated and cleaned before analysis.
Structured, semi-structured, and unstructured data
Organizations handle different types of data that influence operations and decision-making. The table below compares the three categories:
The following table compares structured, semi-structured, and unstructured data by definition, example, and typical business use.
| Data type | Definition | Example | Typical use |
|---|---|---|---|
| Structured | Organized in fixed fields and rows, typically in relational databases and queried with SQL | Sales records, financial transactions, customer profiles | Reporting, trend analysis, regulatory compliance |
| Semi-structured | Contains tags and metadata but doesn’t conform to a rigid database structure | An email’s header fields (sender, timestamp), IoT sensor logs | System integration, predictive maintenance, compliance tracking |
| Unstructured | Has no predefined format | Images, videos, social media posts, an email’s body text | Sentiment analysis, AI-driven automation, media content management |
By leveraging all types of data, enterprises can gain deeper insights, enhance decision-making, and drive business innovation.