ADMAS UNIVERSITY
DEPARTMENT OF COMPUTER SCIENCE
SELLECTED TOPICS IN COMPUTTER SCIENCE
GROUP ASSIGNMENT
Group Members ID
1 kssahun Alemneh…………...........................................................................................................1196\21
2 habtamu Teketel…………………………………………………………………………………………….0141\19
3 Demisew Bereded…………………….............................................................................................1152\21
presentation date………….. ………..NOV 20 \2024
submission date…………………..
sujbmitted to …………………….MR
Introduction to Data Science
Overview for Data Science
Definition of data and information
Data types and representation
Data Value Chain
Data Acquisition
Data Analysis
Data Curating
Data Storage
Data Usage
Basic concepts of Big data
Characteristics of big data
Clustered computing
Benefits of clustered computing
Handoop and its ecosystem
Introduction to Data Science
Introduction to Data Science
What is data science?
Data science is a multi disciplinary field that uses scientific methods, processes,
algorithms, and systems to examain large amount of data
it insights from structured, semi structured and unstructured data.
Data science is simply analyzing data.
Dealing with huge amounts of data to find marketing patterns is known as data science
Data science combines all about: Statistics, Data expertise, Data engineering,
Visualization and Advanced computing
used to analyze large amounts of data and spot trends through formats like data
visualizations and predictive models
Applicaions of data science
1, Healthcare
2, Transportation
3, Sport
4, Government
5, e_ comerce
6, social media
7, logistics
8, gaming
What are data and information?
Data can be defined as a representation of facts,
concepts, or instructions in a formalized manner
It can be described as unprocessed facts and figures.
It is represented with the help of characters such as
Alphabets (A-Z, a-z)
Digits (0-9)or
Special characters(+,-,/,*,<,>,=,etc.)
Measure of data in file
1, bit =1/8 byte
2, Nibble =4 bit =1/2 byte
3, Byte =8 bit
4, Kilobyte = 1024 byte
5, megabyte =1024 KB
6, Gigabyte =1024 MB
7, Terrabyte =1024 GB
8, Petabyte = 1024 TB
9, Exabyte = 1024 PB
10, zettabyte = 1024 EB
11, Yottabyte = 1024 ZB
What are data and information?
Information is the processed data on which decisions
and actions are based.
It is data that has been processed in to a form that is
meaningful to there recipient and is of real or perceived
value in the current or the prospective action or decision
of recipient.
information is interpreted data; created from
organized, structured, and processed data in a
particular context.
Data Processing Cycle
data processing is the re-structuring or re-ordering of
data by people or machines to increase their usefulness
and add values for a particular purpose Data processing
consists of the following basic steps-input, processing,
and out put.
The three steps constitute the data processing cycle
Input data is prepared in some convenient form for
processing.
The form will depend on the processing machine.
Processing the input data is changed to produce data
processi
in more use full forms
input output
g
Data types and their representation
Data types can be described from diverse perspectives.
In computer science and computer programming, for instance, a
data type is simply an attribute of data that tells the compiler or
interpreter how the programme rintends to use the data
Data types from Computer programming perspective
Common data types include
Integers (int)-is used to store whole numbers, mathematically known
as integers
Booleans(bool)- is used to represent restricted to one of two values:
true or false
Characters(char)-is used to store a single character
Floating-point numbers(float)-is used to store real numbers
Alphanumeric strings(string)-used to store a combination of
characters and numbers
Data types from Data Analytics perspective
A data type makes the values that expression, such as a variable or a function,
might take.
This data type defines the operations that can be done on the data, the meaning of
the data, and the way values of that type can be stored
Structured Data
Structured data is data that adheres to a pre-defined data
model and is therefore straight forward to analyze.
Structured data conforms to a tabular format with a
relationship between the different rows and columns.
Common examples of structured data are Excel files or
SQL data bases.
Each of these has structured rows and columns that can be
sorted.
Data types from Data Analytics perspective
Semi-structured data
Semi-structured data is a form of structured data that does not
conform with the formal structure of data models Associated with
relational databases or other forms of data tables, but nonetheless,
contains tags or other markers to separate semantic elements and
enforce hierarchies of records and fields with in the data.
Therefore, it is also known as a self-describing structure.
Examples of semi-structured data include JSON and XML are forms of
semi-structured data.
JSON : java script object Notation: is data interchange format that
uses human readable text to store and transmit data.
XML : extensible markup language provides rules to define
any data
Data types from Data Analytics perspective
Unstructured Data
Unstructured data is information that either does not have a predefined
data model or is not organized in a pre-defined manner.
Can not displayed in rows, columens and relational database
It requirs more storage and defficult to manage and protect
Unstructured information is typically text-heavy but may contain data such
as dates, numbers, and facts as well.
This results in irregularities and ambiguities that make it difficult to
understand using traditional programs as compared to data stored in
structured databases.
Common examples of unstructured data include audio, video files or No-
Metadata –Data about Data
The last category of data type is metadata. From a
technical point of view, this is not a separate data
structure, but it is one of the most important elements for
Big Data analysis and big data solutions.
Metadata is data about data. It provides additional
information about a specific set of data.
In a set of photographs, for example, metadata could
describe when and where the photos were taken.
The metadata then provides fields for dates and
locations which, by themselves, can be considered
structured data. Because of this reason, metadata is
frequently used by Big Data solutions for initial analysis.
Data value Chain
Data Value Chain is introduced to describe the information flow
with in a big data system
a series of steps needed to generate value and useful in sights from
data.
The Big Data Value Chain identifies the following key high-level
activities:
Data Acquisition It is the process of collecting, filtering, and
cleaning data before it is put in a data warehouse
Data acquisition is one of the major big data challenges interms of
infrastructure requirements
The infrastructure required to support the acquisition of big data
must deliver low, predictable latency in both capturing data and in
executing queries.
Used in distributed environment; and support flexible and dynamic
Data value Chain
Data Analysis is making the raw data acquired amenable to use in decision-
making.
Data analysis involves exploring ,transforming ,and modeling data
the goal of high lighting relevant data, synthesizing and extracting useful hidden
information with high potential from a business point of view.
Related areas include data mining, business intelligence, and machine learning
Data Curation It is the active management of data over its life cycle
Data curation processes can be categorized into different activities such as
content creation, selection, classification, transformation, validation, and
preservation.
Data curation is performed by expert curators that are responsible for
improving the accessibility and quality of data.
Data curators (also known as scientific curators or data annotators) hold the
responsibility of ensuring that data are trust worthy, discoverable ,accessible,
reusable and fit their purpose.
A key trend for the duration of big data utilizes community and crowdsourcing
approaches.
Data value Chain
Data Storage
It is the persistence and management of data in a scalable way that
satisfies the needs of applications that require fast access to the data.
Relational Database Management Systems (RDBMS) have been the
main, and almost unique, a solution to the storage paradigm .
the ACID (Atomicity, Consistency, Isolation, and Durability) properties
that guarantee database transactions.
NoSQL technologies have been designed with the scalability goal in
mind and present a wide range of solutions based on alternative data
models
Data Usage
It covers the data-driven business activities that need access to data,
its analysis, and the tools needed to integrate the data analysis with in
the business activity.
Data usage in business decision-making can enhance competitiveness
Basic concepts of big data
Big data non-traditional strategies and technologies needed
to gather, organize, process, and gather insights from large data
sets.
Large, complex and divers data sets
Big data is a collection of data sets so large and complex that it
becomes difficult to process using on traditional data processing
applications.
“large dataset” means a data set tool large to reasonably
process or store with traditional tooling or on a single computer.
Big data is characterized by 3V and more:
Volume: large amounts of data /Massive datasets has been
generated
Velocity: Data is live streaming or in motion
Variety : data comes in many different forms from diverse sources
Veracity: can quality, accuracy or trustworthiness of the data
Clustered Computing
Clustered Computing
Because of the qualities of big data, individual computers are
often inadequate for handling the data at most stages.
To better address the high storage and computational needs
of big data, computer clusters are a better fit.
Is acollection of losely connected computers that works
togethet and they act as a single entity
Big data clustering software combines the resources of many
smaller machines, seeking to provide a number of benefits:
Cluster computing benefits
Resource Pooling
High Availability
Easy Scalability
Clustered Computing
Cluster computing benefits
Resource Pooling
Combining the available storage space to hold data is a clear benefit but CPU and
memory pooling are also extremely important
High Availability
Clusters can provide varying levels of fault tolerance and availability guarantees to
prevent hardware or software failures from affecting access to data and processing.
Easy Scalability
Clusters make it easy to scale horizontally by adding additional machines to the
group.
Clusters requires a solution for managing cluster membership, coordinating resource
sharing, and scheduling actual work on individual nodes.
Cluster membership and resource allocation can be handled by software like
Hadoop’s YARN (Yet Another Resource Negotiator).
Hadoop and its Ecosystem
Hadoop is an open-source apache software framework intended to make
interaction with big data easier.
A framework that allows for the distributed processing of large datasets
across clusters of computers using simple programming models.
It is inspired by a technical document published by Google.
Key characteristics of Hadoop
Economical: Its systems are highly economical as ordinary computers
can be used for data processing.
Reliable: It is reliable as it stores copies of the data on different machines
and is resistant to hardware failure
Scalable: It is easily scalable both, horizontally and vertically. A few extra
nodes help in scaling up the framework.
Flexible:It is flexible and you can store as much structured and
unstructured data as you need to and decide to use them later
Hadoop and its Ecosystem
Hadoop ecosystem consists of a variety of components that work together
to provide a comprehensive framework for processing and managing large
datasets.
HDFS : Hadoop Distributed File System : It is designed to store large files
across multiple machines in a distributed manner.
YARN: Yet Another Resource Negotiator: is the resource management layer
of Hadoop.
MapReduce: is the programming model used for processing large
datasets in parallel across a Hadoop cluster.
MapReduce consists of two main tasks:
the Map task, which processes input data and generates intermediate key-
value pairs
the Reduce task, which aggregates these intermediate results.
Spark: is a fast, in-memory data processing engine that can run on top of
Hadoop.
Big Data Life Cycle with Hadoop
Ingesting data into the system
The first stage of Big Data processing is Ingest.
The data is ingested or transferred to Hadoop from various sources
such as relational databases, systems, or local files.
Processing the data in storage
The second stage is Processing. In this stage , the data is stored and
processed.
The data is stored in the distributed file system.
Computing and analyzing data
The third stage is to Analyze. Here, the data is analyzed by
processing frameworks such as Pig , Hive , and Impala.
Visualizing the results
The fourth stage is Access, which is performed by tools such as Hue
and Cloudera Search.
In this stage the analyzed data can be accessed by users.
Summery questions
1.What do you mean by data science?
2. Structured vs unstructured data?
4. What is the difference between BI (Business intelligence) and Data
science?
5. What are benefits of Cluster computing?
6. ____ is the process of gathering, filtering, and cleaning data before it is put
in a data warehouse
7. _____provides additional information about a specific set of data
8. List the characterstics of big data
a. __________
b. __________
c. __________
d __________
End of chapter
THANK YOU
