Key facts

UNE unit code: COSC531

*You are viewing the 2027 version of this unit which may be subject to change in future.

Start
  • Trimester 2 - On Campus
  • Trimester 2 - Online
Campus
  • Armidale Campus
24/7 online support
  • Yes
Intensive schools
  • No
Supervised exam
  • Yes
Credit points
  • 6

Unit information

UNE student studies on a laptop on her lounge at home

Data has become a driving force that shapes decisions, innovations, and strategies across all industries and domains. Our capacity to capture and store data has expand at an unprecedented pace and, when coupled with machine learning and artificial intelligence, data can shape the experiences we encounter in many areas of our lives. This unit covers the technologies and paradigms that enable us to extract meaning from large datasets. You will work through topics that cover transformation, mapping and filtering data using workflows based on industry-leading platforms for big data processing. You will work with pre-processing and feature engineering approaches and use these in machine learning workflows for classification and regression tasks on large data sets.

Offerings

For further information about UNE's teaching periods, please go to Principal Dates.

Teaching period
Mode/location
Trimester 2On Campus, Armidale Campus
Trimester 2Online

*Offering is subject to availability

Intensive schools

There are no intensive schools required for this unit.

Enrolment rules

Pre-requisites
candidature in the GradDipSc or MDataSc or MInfoTech or MScStud or MArtInt [Rule (b) or (c)]; or (COSC110 or COSC102) and AMTH405 and (12cps of COSC or STAT coded units at 200-level or higher) and candidature in the MArtInt [Rule (a)].
Co-requisites
None
Restrictions
COSC331
Combined units

Notes

COSC531 requires a knowledge of and programming experience with a high-level language. Experience with the use of the Linux/UNIX operating system is highly recommended.

Please refer to the student handbook for current details on this unit.

Unit coordinator(s)

profile photo of Mitchell Welch
Mitchell WelchAssociate Professor of Computational Science, Computer Science - Precision Agriculture Research Group (PARG); School of Science and Technology

Learning outcomes

Upon completion of this unit, students will be able to:

  1. describe and analyse the challenges involved with processing large datasets;
  2. develop applications and assess workflows for transforming, mapping and filtering large datasets using a distributed processing platform;
  3. work with datasets using a range of suitable structures, formats and tools that enable efficient processing at a large scale;
  4. analyse and apply pre-processing and feature engineering workflows to large datasets using a distributed processing platform;
  5. apply machine learning algorithms, interpret their outputs and assess their performance using suitable technologies and workflows; and
  6. analyse and develop programs that apply data processing and machine learning according to a given specification.

Assessment information

Assessments are subject to change up to 8 weeks prior to the start of the teaching period in which you are undertaking the unit.

TitleMust CompleteWeightOfferingsAssessment Notes
Development Project - Assurance TaskYes25%All offerings

Major project. Implementation of a machine learning workflow to solve a complex problem.  It is mandatory to pass this component in order to pass the unit.

Final Examination - Assurance TaskYes60%All offerings

Final Exam. Students must obtain 40% in this component in order to pass the unit.

There is a supervised exam at the end of the teaching period in which you are enrolled. The exam will be offered online with supervision via webcam and screen sharing technology. Coordinated by UNE Exams Unit.

Practical Assignment 1Yes7.5%All offerings

Programming Task

Practical Assignment 2 Yes7.5%All offerings

Programming Task

Learning resources

Textbooks are subject to change up to 8 weeks prior to the start of the teaching period in which you are undertaking the unit.

Note: Students are expected to purchase prescribed material. Please note that textbook requirements may vary from one teaching period to the next.

Spark: The Definitive Guide

ISBN: 9781491912218

Bill Chambers and Matei Zaharia, O'Reilly Media, Inc. February 2018

Text refers to: All offerings

Excellence in experience, equity and employability

2026 Overall Experience

Five Stars,
20 Years in a Row

UNE is the only public uni in Australia awarded 20 straight years of five stars for Overall Experience.

Good Universities Guide 2007-2026
2026 Social Equality

Five Stars for
Social Equity

UNE rates among the top 20% of universities nationally and is #1 in NSW for Social Equity.

Good Universities Guide 2026
2026 Graduate Employment

Five Stars for
Graduate Employment

UNE rates among the top 20% of universities for Graduate Full-Time Employment and Starting Salary.

Good Universities Guide 2026 (Undergraduate)
2026 Diamond-Rated Digital Learning

Diamond-Rated Digital Learning

UNE’s leadership in digital learning earned the highest ‘Diamond’ rating in a peer review.

ASCILITE TELAS 2025
Woman studying online at home

Studying online

At UNE we know it takes more than just being online to be a great online university. It takes time and experience. We pioneered distance education for working adults back in the 1950s, so we’ve been doing this longer than any other Australian university.

We understand the challenges faced by busy adults studying at home. We know that a vital part of online study is your engagement with the learning community. Communication with your classmates, teaching staff and university support staff will enhance your study experience and ensure that your skills extend beyond the subject matter. UNE’s teaching staff are experts in their field which is why UNE consistently receives five stars from students for teaching quality, support and overall experience.*

*The Good Universities Guide

Stay connected

Join our mailing list for updates and helpful tips to support your study plans. You can unsubscribe at any time.

  • Course updates and important changes as they happen
  • Key dates for intakes, deadlines, and enrolment steps
  • Application guidance, including supporting documentation requirements
  • Next steps and what to expect after you apply or enquire

Ready to stay in the loop?

GET IN TOUCHUniversity campus with students on a sunny day, historic brick building and green lawn

Why study with us?

Graduate Jess Trow, Bachelor of Education (K–6)

UNE’s flexibility and support made the transition smooth and helped me find a great balance between academic responsibilities and personal growth. It was the perfect place to study education while staying true to my rural roots.

Jess Trow, Bachelor of Education (K–6)

What happens next?

laptop icon
1. Decide on your course

Got a question about a course you'd like to study? Contact our Future Student Team for help.

pencil icon
2. Apply

2027 applications are now open. The application process only takes 20 minutes to complete. Don’t delay, apply now!

form icon
3. Receive an offer, enrol and start studying

Your start date is based on the study period you choose to apply for.