Probability is a mathematical discipline for reasoning about randomness -- it helps us make decisions in the face of uncertainty and build better systems. In this course, we will teach you the fundamental ideas of probability and random processes. The various assignments are carefully designed to strengthen your mathematical understanding of probability and to demonstrate how these concepts can be applied to the real world, be it in communication networks, control systems, or machine learning.
Knowledge of probability at the level of CS 70, Stat 134, or Stat 140; linear algebra at the level of EECS 16A or Math 54.
- Fundamentals of Probability / 4 weeks
- Review of probability basics and common distributions
- Transforms of random variables, concentration inequalities
- Convergence, law of large numbers, central limit theorem
- Information Theory and Random Processes / 5 weeks
- Information theory
- Discrete time Markov chains
- Poisson processes
- Continuous time Markov chains
- Estimation and Hilbert Space of Random Variables / 4 weeks
- Maximum likelihood estimate, maximum a posteriori estimate, hypothesis testing
- Hilbert space of random variables
- LLSE estimate, MMSE estimate
- Jointly Gaussian random variables and Kalman filter
- Hidden Markov models
The course will follow the B&T textbook, as well as the new Walrand textbook which you can find here.
- Dimitris P. Bertsekas and John N. Tsitsiklis, Introduction to Probability, 2nd Edition, Athena Scientific, 2008.
- Jean Walrand, Probability in Electrical Engineering and Computer Science: An Application-Driven Course, Springer, 2021.
We will be using Ed for class discussion. Rather than emailing questions to the GSIs, we encourage you to post your questions on Ed. If you can't access the course, please contact course staff at eecs126-inst (at) berkeley.edu.
Expectations Regarding Conduct Online
It shouldn't have to be said, but please keep your online posts constructive, respectful, and course-related. We want Ed Discussion to be a resource that promotes a positive and inclusive culture for learning and collaboration. Trolling, rants, or other abusive behavior that does not contribute to this goal won't be tolerated, and may result in revocation of your forum privileges. In short, keep it professional.
We will use Gradescope for all submissions/grade-related items. If you are not added automatically, please use the code J3V4Z6 to join. Note that our policy for accepting assignments (not exams) is that if Gradescope accepts the assignment, it is accepted, even if it says late or assigns a late timestamp.
The grading breakdown is as follows:
- Homework (15%)
- Lab (10%)
- Midterm 1 (20%)
- Midterm 2 (20%)
- Final (35%)
We will be using a clobber policy where your final can replace your grade for either MT1 or MT2, but not both.
In situations that will foreseeably result in a need for accommodation, requests must be made no later than Friday Feb. 12th using this form. For emergency requests due to unforeseen circumstances, please make a private Ed post.
See the exams page for more details.
- Homeworks will be posted on the course website every Wednesday morning and are due on the following Tuesday at 10:59 PM.
- Homeworks should be submitted as a PDF to Gradescope.
- Any homework that is illegible or too difficult to read will get a 0.
- Homeworks will be self-graded through Gradescope.
- You will get the opportunity to make back 50% of your missed points by resubmitting your answer to the homework. Resubmissions are done problem by problem; you may resubmit multiple problems and you must complete ALL parts of any problems you are resubmitting.
- Resubmissions must be handwritten (on paper or through an application, but they may not be typed up). Indicate all problems you are resubmitting and upload your resubmission as a PDF on the Gradescope assignment.
- Self-grades and resubmissions will open the Wednesday morning immediately following the homework deadline, and are due the next Tuesday at 10:59 PM.
- You will have a 1 hour grace period to submit the homework, self-grade, and resubmission. No late submissions will be accepted after that.
- Each homework score is calculated like so:
- Readers will be grading select problems on each homework, and we will be checking for consistent and significant deviations between self-grades and reader grades. We will be spot checking resubmissions as well. Please self-grade and resubmit your homeworks fairly!
- Labs will be posted on the course website every Saturday morning and are due on the following Friday at 10:59 PM.
- Labs will be in the form of Jupyter notebooks. Students should submit these notebooks as a .pdf to Gradescope.
- Labs will be self-graded through Gradescope. The assignments will open every Saturday morning and are due on the following Friday at 10:59 PM.
- You will have a 1 hour grace period to submit the lab and self-grade. No late self grades or lab submissions will be accepted after that.
- Labs will be entirely graded by readers -- no self-grades needed!
We will periodically be checking self-grades internally to ensure that they are accurate. If we find that your self-grades do not align with our scores (either positively or negatively), we will reach out to you and adjust your self-grades. Please remember the Academic Dishonesty policy and the Berkeley honor code and try to report your self-grades accurately.
Each problem is worth 4 points:
- 4: fully correct
- 3: minor mistakes, close to correct solution
- 2: major mistakes, incorrect direction
- 1: little progress
- 0: not attempted
For problems with subparts, we will specify the breakdown; apply to rubric similarly to each subpart.
You are encouraged to discuss homework and lab assignments with your classmates. However, you must always write up the solutions on your own, and you must never copy the solutions of other students. Similarly, you may use books or online resources to help solve homework problems, but you must credit all such sources in your writeup and you must never copy material verbatim. You are reminded of the Department's Policy on Academic Dishonesty. In particular, you should be aware that copying solutions, in whole or in part, from other students in the class or any other source without acknowledgment constitutes a violation of this policy and risks serious consequences.
Policy on Course Content
The University's Policy on Classroom Note-Taking and Recording applies to this course. You are free and encouraged to use course materials for personal use (in collaborations with other students, in your research, etc.). You are also granted permission to post any notes you create on your own personal website. You are expressly prohibited from publicly uploading course materials created by teaching staff (exams, HW, solutions, labs). In particular, any upload of course content to websites such as CourseHero.com or Chegg.com, which distribute and monetize content without permission from the instructor or University will be considered a violation of University Policy, and referred to the Center for Student Conduct.