Note updates

Milestones, releases, and associated publications in reverse chronological order.

  1. Update

    Lecture 5: Sequential Games and Rademacher Complexity

    Lecture 5 adds a complete handout and detailed explanation in both languages, with original numbering, proofs, examples, and qualifications.

    Adds the [Lecture 5 Detailed Explanation](/notes/csci678/lecture-5-explanation) and [Full Handout](/notes/csci678/lecture-5-full-translation). Derives tree symmetrization from minimax duality and martingale differences, explaining dependent data, binary relabeling, and contraction conditions. Both documents have matching Chinese editions through the language switcher. The source handout is not published online; all original results, equation numbers, algorithms, and footnote information are preserved, with editorial additions explicitly distinguished.
  2. Update

    Lecture 6: Zero-Covers, Littlestone Dimension, and Online Regression

    Lecture 6 adds a complete handout and detailed explanation in both languages, with original numbering, proofs, examples, and qualifications.

    Adds the [Lecture 6 Detailed Explanation](/notes/csci678/lecture-6-explanation) and [Full Handout](/notes/csci678/lecture-6-full-translation). Develops sequential Sauer, threshold and monotone counterexamples, regression entropy integrals, and surrogate normalization. Both documents have matching Chinese editions through the language switcher. The source handout is not published online; all original results, equation numbers, algorithms, and footnote information are preserved, with editorial additions explicitly distinguished.
  3. Update

    Lecture 7: Hedge, Partial Covers, and Perceptron

    Lecture 7 adds a complete handout and detailed explanation in both languages, with original numbering, proofs, examples, and qualifications.

    Adds the [Lecture 7 Detailed Explanation](/notes/csci678/lecture-7-explanation) and [Full Handout](/notes/csci678/lecture-7-full-translation). Derives the exponential-weights potential, mistake-indexed experts, and the Perceptron bound, with margin and dimension qualifications. Both documents have matching Chinese editions through the language switcher. The source handout is not published online; all original results, equation numbers, algorithms, and footnote information are preserved, with editorial additions explicitly distinguished.
  4. Update

    Lecture 4: Fat-Shattering, Spectral Complexity, and Margins

    Lecture 4 gains a full handout edition and detailed explanation in both languages, preserving both figures and expanding the covering, error-propagation, and allocation arguments.

    CSCI 678 adds the [Lecture 4 Detailed Explanation](/notes/csci678/lecture-4-explanation) and [Full Handout](/notes/csci678/lecture-4-full-translation). They connect fat-shattering and monotone-class learning rates with neural-network covers, spectral complexity, and margin generalization bounds. The explanation adds the atom-sampling proof, internal-cover constants, the KKT calculation for layerwise error allocation, and a two-layer numerical example. Both original experiment figures are retained, with explicit notes on normalization, endpoints, and the abbreviated high-probability statement. Matching Chinese pages are available through the language switcher.
  5. Update

    Lecture 1 and 2 notes published

    CSCI 678 now covers Lectures 1 and 2: each lecture gets a detailed explanation report and a full slide translation, with the English text restored from the original slides.

    The CSCI 678 project adds Lecture 1 and 2 materials, two companion documents per lecture: the [Lecture 1 explanation](/notes/csci678/lecture-1-explanation) with its [full slide translation](/notes/csci678/lecture-1-full-translation), and the [Lecture 2 explanation](/notes/csci678/lecture-2-explanation) with its [full slide translation](/notes/csci678/lecture-2-full-translation). The English text of the slide translations is restored from the original slides. Notes for Lectures 1-3 are now all online.
  6. Update

    Lecture 3 full translation published

    CSCI 678 adds a complete Chinese-to-English translation of the Lecture 3 slides, preserving the original theorem numbering and proof structure for side-by-side reading with the preview report.

    The CSCI 678 project adds the [Lecture 3 Full Translation](/notes/csci678/lecture-3-full-translation): the complete content of the three parts — covering functions, covering projections, Dudley's entropy integral with the chaining technique, and pseudo-dimension — with mathematical notation, theorem numbering, and proof structure preserved from the original slides. Read it alongside the [Lecture 3 Preview Report](/notes/csci678/lecture-3-preview).
  7. Update

    CSCI 678 added as a Project

    Study notes for CSCI 678 Theoretical Machine Learning join Derek Hub as a standalone Project, with the first Lecture 3 preview report published alongside.

    Study notes for CSCI 678 (Theoretical Machine Learning, Fall 2026, Haipeng Luo) join this site as a standalone Project. The first document is the [Lecture 3 Preview Report](/notes/csci678/lecture-3-preview), covering pointwise covering, sample-projection covering, Dudley's entropy integral, and pseudo-dimension for infinite real-valued function classes. Notes for later lectures will be added over time.

Search the site

Notes
Blog
Projects
Resources
About me