Key facts
UNE unit code: COSC531
*You are viewing the 2027 version of this unit which may be subject to change in future.
- Trimester 2 - On Campus
- Trimester 2 - Online
- Armidale Campus
- Yes
- No
- Yes
- 6
Unit information

Data has become a driving force that shapes decisions, innovations, and strategies across all industries and domains. Our capacity to capture and store data has expand at an unprecedented pace and, when coupled with machine learning and artificial intelligence, data can shape the experiences we encounter in many areas of our lives. This unit covers the technologies and paradigms that enable us to extract meaning from large datasets. You will work through topics that cover transformation, mapping and filtering data using workflows based on industry-leading platforms for big data processing. You will work with pre-processing and feature engineering approaches and use these in machine learning workflows for classification and regression tasks on large data sets.
Offerings
For further information about UNE's teaching periods, please go to Principal Dates.
| Teaching period | Mode/location |
|---|---|
| Trimester 2 | On Campus, Armidale Campus |
| Trimester 2 | Online |
*Offering is subject to availability
Intensive schools
There are no intensive schools required for this unit.
Enrolment rules
Notes
COSC531 requires a knowledge of and programming experience with a high-level language. Experience with the use of the Linux/UNIX operating system is highly recommended.
Please refer to the student handbook for current details on this unit.
Unit coordinator(s)

Learning outcomes
Upon completion of this unit, students will be able to:
- describe and analyse the challenges involved with processing large datasets;
- develop applications and assess workflows for transforming, mapping and filtering large datasets using a distributed processing platform;
- work with datasets using a range of suitable structures, formats and tools that enable efficient processing at a large scale;
- analyse and apply pre-processing and feature engineering workflows to large datasets using a distributed processing platform;
- apply machine learning algorithms, interpret their outputs and assess their performance using suitable technologies and workflows; and
- analyse and develop programs that apply data processing and machine learning according to a given specification.
Assessment information
Assessments are subject to change up to 8 weeks prior to the start of the teaching period in which you are undertaking the unit.
| Title | Must Complete | Weight | Offerings | Assessment Notes |
|---|---|---|---|---|
| Development Project - Assurance Task | Yes | 25% | All offerings | Major project. Implementation of a machine learning workflow to solve a complex problem. It is mandatory to pass this component in order to pass the unit. |
| Final Examination - Assurance Task | Yes | 60% | All offerings | Final Exam. Students must obtain 40% in this component in order to pass the unit. There is a supervised exam at the end of the teaching period in which you are enrolled. The exam will be offered online with supervision via webcam and screen sharing technology. Coordinated by UNE Exams Unit. |
| Practical Assignment 1 | Yes | 7.5% | All offerings | Programming Task |
| Practical Assignment 2 | Yes | 7.5% | All offerings | Programming Task |
Learning resources
Textbooks are subject to change up to 8 weeks prior to the start of the teaching period in which you are undertaking the unit.
Note: Students are expected to purchase prescribed material. Please note that textbook requirements may vary from one teaching period to the next.
Spark: The Definitive Guide
ISBN: 9781491912218
Bill Chambers and Matei Zaharia, O'Reilly Media, Inc. February 2018
Text refers to: All offerings
Excellence in experience, equity and employability
Five Stars,
20 Years in a Row
UNE is the only public uni in Australia awarded 20 straight years of five stars for Overall Experience.
Good Universities Guide 2007-2026Five Stars for
Social Equity
UNE rates among the top 20% of universities nationally and is #1 in NSW for Social Equity.
Good Universities Guide 2026Five Stars for
Graduate Employment
UNE rates among the top 20% of universities for Graduate Full-Time Employment and Starting Salary.
Good Universities Guide 2026 (Undergraduate)Diamond-Rated Digital Learning
UNE’s leadership in digital learning earned the highest ‘Diamond’ rating in a peer review.
ASCILITE TELAS 2025
Studying online
At UNE we know it takes more than just being online to be a great online university. It takes time and experience. We pioneered distance education for working adults back in the 1950s, so we’ve been doing this longer than any other Australian university.
We understand the challenges faced by busy adults studying at home. We know that a vital part of online study is your engagement with the learning community. Communication with your classmates, teaching staff and university support staff will enhance your study experience and ensure that your skills extend beyond the subject matter. UNE’s teaching staff are experts in their field which is why UNE consistently receives five stars from students for teaching quality, support and overall experience.*
*The Good Universities Guide
Stay connected
Join our mailing list for updates and helpful tips to support your study plans. You can unsubscribe at any time.
- •Course updates and important changes as they happen
- •Key dates for intakes, deadlines, and enrolment steps
- •Application guidance, including supporting documentation requirements
- •Next steps and what to expect after you apply or enquire
Ready to stay in the loop?
GET IN TOUCH
Why study with us?

UNE’s flexibility and support made the transition smooth and helped me find a great balance between academic responsibilities and personal growth. It was the perfect place to study education while staying true to my rural roots.
What happens next?
Got a question about a course you'd like to study? Contact our Future Student Team for help.
2027 applications are now open. The application process only takes 20 minutes to complete. Don’t delay, apply now!
Your start date is based on the study period you choose to apply for.