30416 - BIG DATA AND DATABASES
Department of Decision Sciences
Course taught in English
Go to class group/s: 25
Course Director:
LUCA MOLTENI
LUCA MOLTENI
Suggested background knowledge
Basic descriptive and inferential statistics knowledge, basic computer skills.
Mission & Content Summary
MISSION
The course provides an overview of data management architectures and analytics procedures aimed at organising, describing and modeling Big Data (structured and unstructured). The contents of the course covers both technical aspects of data management / analytics and topics related to analysis managerial evaluation (how to translate the outputs into meaningful business insights).
CONTENT SUMMARY
- Introduction to data management and analytics.
- Data management architectures: relational databases (OLTP, Data warehouse and SQL language).
- Data management architectures: Big data and NoSQL databases (distributed file system, Hadoop, Spark and Data Lake concept).
- Data analytics: Data understanding and data preparation.
- Data analytics: Models and statistical techniques applied to Big Data.
- Regression and classification trees.
- Ensemble methods (random forest and boosted trees).
- Logistic regression.
- Supervised Artificial Neural Networks.
- Data analytics: Models' performance evaluation.
Intended Learning Outcomes (ILO)
KNOWLEDGE AND UNDERSTANDING
At the end of the course student will be able to...
Get the following competences:
- Big Data ingestion and management.
- Data preparation and cleaning.
- Machine learning algorithms application.
- Machine learning model evaluation.
APPLYING KNOWLEDGE AND UNDERSTANDING
At the end of the course student will be able to...
- Improve his skills to manage and to take advantages of the huge availability of data nowadays produced by a great variety of sources.
Teaching methods
- Guest speaker's talks (in class or in distance)
- Practical Exercises
- Collaborative Works / Assignments
DETAILS
Two different approaches are used: theoretical and applicative.
- A number of data ingestion procedures and machine learning data analysis case histories are shown, on Big and Small Data, using specific data management anf machine learning software.
- At the end of the course, students are able to reply all the procedures and analysis by themselves.
Assessment methods
Continuous assessment | Partial exams | General exam | |
---|---|---|---|
|
x |
ATTENDING STUDENTS
The assignments assess the student's ability to perform data analysis. The written exam aims mainly to assess the knowledge and the understanding of the procedures required for data ingestion and management and the main features of the machine learning algorithms presented in the course.
NOT ATTENDING STUDENTS
The written exam aims mainly to assess the knowledge and the understanding of the procedures required for data ingestion and management, the main features of the machine learning algorithms presented in the course and the ability to interpret the content of a machine learning software output.
Teaching materials
ATTENDING AND NOT ATTENDING STUDENTS
- M. KUHN, K. JOHNSON, Applied predictive modeling, Springer, 2013.
- P. WILTON, J. W. COLBY, Beginning SQL, Wrox, March 04, 2005.
- N. DASGUPTA, Practical Big Data Analytics, Packt Publishing, 2018.
- Teachers' slides.
Last change 10/07/2024 16:10