Key facts
UNE unit code: COSC531
*You are viewing the 2024 version of this unit which may be subject to change in future.
- Not offered in 2024
- Armidale Campus
- UNE Sydney Campus
- Yes
- No
- No
- 6
Unit information
Data has become a driving force that shapes decisions, innovations, and strategies across all industries and domains. Our capacity to capture and store data has expand at an unprecedented pace and, when coupled with machine learning and artificial intelligence, data can shape the experiences we encounter in many areas of our lives. This unit covers the technologies and paradigms that enable us to extract meaning from large datasets. You will work through topics that cover transformation, mapping and filtering data using workflows based on industry-leading platforms for big data processing. You will work with pre-processing and feature engineering approaches and use these in machine learning workflows for classification and regression tasks on large data sets.
Intensive schools
There are no intensive schools required for this unit.
Enrolment rules
Notes
COSC531 requires a knowledge of and programming experience with a high-level language. Experience with the use of the Linux/UNIX operating system is highly recommended.
Please refer to the student handbook for current details on this unit.
Unit coordinator(s)
Learning outcomes
Upon completion of this unit, students will be able to:
- describe and analyse the challenges involved with processing large datasets;
- develop applications and assess workflows for transforming, mapping and filtering large datasets using a distributed processing platform;
- work with datasets using a range of suitable structures, formats and tools that enable efficient processing at a large scale;
- analyse and apply pre-processing and feature engineering workflows to large datasets using a distributed processing platform;
- apply machine learning algorithms, interpret their outputs and assess their performance using suitable technologies and workflows; and
- analyse and develop programs that apply data processing and machine learning according to a given specification.
Assessment information
Assessments are subject to change up to 8 weeks prior to the start of the teaching period in which you are undertaking the unit.
| Title | Must Complete | Weight | Offerings | Assessment Notes |
|---|---|---|---|---|
| Development Project | Yes | 40% | All offerings | Machine Learning Workflow Implementation. It is mandatory to pass this component in order to pass the unit. |
| Open Book Examination | Yes | 40% | All offerings | Open Book Examination. It is mandatory to pass this component in order to pass the unit. |
| Practical Assignment 1 | Yes | 10% | All offerings | Programming Task |
| Practical Assignment 2 | Yes | 10% | All offerings | Programming Task |
Learning resources
Textbooks are subject to change up to 8 weeks prior to the start of the teaching period in which you are undertaking the unit.
Note: Students are expected to purchase prescribed material. Please note that textbook requirements may vary from one teaching period to the next.
Spark: The Definitive Guide
ISBN: 9781491912218
Bill Chambers and Matei Zaharia, O'Reilly Media, Inc. February 2018
Text refers to: All offerings
A five-star experience
Five Stars,
18 Years in a Row
UNE is the only public uni in Australia awarded 18 straight years of five stars for Overall Experience
Good Universities Guide 2007-2024
No.1 in NSW for
Student Experience
QILT (government-endorsed) ranks UNE as the top public NSW uni for Student Experience
QILT Student Experience Survey
Five Stars for
Teaching Quality
UNE rates among the top 20 per cent of universities in Australia for Teaching Quality
Good Universities Guide 2024
Studying online
At UNE we know it takes more than just being online to be a great online university. It takes time and experience. We pioneered distance education for working adults back in the 1950s, so we’ve been doing this longer than any other Australian university.
We understand the challenges faced by busy adults studying at home. We know that a vital part of online study is your engagement with the learning community. Communication with your classmates, teaching staff and university support staff will enhance your study experience and ensure that your skills extend beyond the subject matter. UNE’s teaching staff are experts in their field which is why UNE consistently receives five stars from students for teaching quality, support and overall experience.*
*The Good Universities Guide
Stay connected
Register your interest and we'll keep you updated
Why study with us?
I'm grateful to UNE for the opportunities studying has given me, but above all, for making me realise I could actually do it, and giving me a sense of accomplishment.
What happens next?
Got any questions about a course you would like to study? Don’t hesitate to contact us, our Future Student team is standing by to help.
2024 applications are now open. The application process only takes 20 minutes to complete. Don’t delay, apply now!
Your start date is based on the study period you choose to apply for.
