Course number:
CSE or ISE 334
Course title:
"Introduction to Multimedia Systems"
Course description:
This is a survey course of both electronic and digital media technologies.
Students learn a wide variety of multimedia standards, formats, and data
types; and develop proficiency with industry-standard tools for capturing,
editing, and processing media. Relevance to software development, such as
interface design or digital entertainment, is demonstrated through case studies.
The nature of light and sound, and the biology of human perception are explored
along with implications for digital representation of information. Intellectual
property rights and other ethical issues related to media are discussed.
Students work independently on lab exercises and build a final multimedia
project that integrates the exercises.
Prerequisite(s):
U3 or higher status.
Number of credits:
3
Course topics:
What is Multimedia?
Conduits of information: print, broadcast, internet
Vehicles of expression: text, graphics, animation, audio, video, 3D
Multimedia systems approach (Shannon)
The Nature of Information
Analog Events, Digital Recordings
Waveforms
Electromagnetic Spectrum
Color models
Frequency and Amplitude, Pitch and Volume, Color and Brightness
Transducers
Sampling rate, quantization
Aliasing
The Biology and Psychology of Human Perception
Visible spectrum
Auditory range
Sensory bandwidth
Psychology of color
Pattern recognition
The Design of Information
Aspect ratio and figure-ground relationships
Design of statistical and schematic data (Tufte)Images
Image capture
Rasterizing
Graphics formats
Digital color and palettes
Graphics compression
Text and Graphics
Vector graphics
Icons
Text formats, character sets, and fonts
Typography
Audio
Audio capture
Digital audio vs. MIDI
Audio formats
Audio compression
Animation
Animation principles
Frame rate
Rotoscopy
Interpolation
Kinematics
Animation formats
3D
3D modeling
Motion capture
Texture mapping
3D formats
3D animation
Video
Video capture
Analog video vs. digital video
Video formats and standards
Video compression
Course objectives:
Upon completion of the course students should demonstrate an understanding
of multimedia standards and their perceptual limitations. Students should
also
be able to digitize and process audio and images, and compress and encode the
files appropriately for a variety of delivery methods. They should be able
to capture motion and render it realistically, and should also be able
to model objects in 3D, render, and animate them. Finally students should be
able to synchronize these diverse media elements in a linear presentation.
Computer usage:
Software tools include GIMP, Inkscape, Audacity, and Blender.
Course webpage:
https://www3.cs.stonybrook.edu/~tony/intromm/
Course email:
intromm@cs.stonybrook.edu
Americans with Disabilities Act: If you have a physical, psychological, medical or learning disability that may impact your course work, please contact Disability Support Services, ECC (Educational Communications Center) Building, Room 128, (631) 632-6748. They will determine with you what accommodations, if any, are necessary and appropriate. All information and documentation is confidential.
Academic Integrity: Each student must pursue his or her academic goals honestly and be personally accountable for all submitted work. Representing another person's work as your own is always wrong. Faculty are required to report any suspected instances of academic dishonesty to the Academic Judiciary. Faculty in the Health Sciences Center (School of Health Technology & Management, Nursing, Social Welfare, Dental Medicine) and School of Medicine are required to follow their school-specific procedures. For more comprehensive information on academic integrity, including categories of academic dishonesty, please refer to the academic judiciary website at http://www.stonybrook.edu/uaa/academicjudiciary/
Critical Incident Management: Stony Brook University expects students to respect the rights, privileges, and property of other people. Faculty are required to report to the Office of Judicial Affairs any disruptive behavior that interrupts their ability to teach, compromises the safety of the learning environment, or inhibits students' ability to learn.
Minimal Student Responsibilities: http://sb.cc.stonybrook.edu/bulletin/current/policiesandregulations/policies_expectations/min_instructional_student_resp.php
Course coordinator and instructor:
Tony Scarlatos
anthony.scarlatos@stonybrook.edu