Paper Review - Preference Learning (WIP)
Quick notes on Ranking Preference Optimization, covering Bradley–Terry (BT) Model and Plackett–Luce (PL) Model.
Paper Review - FramePack and Anti-drifting Sampling
Make video diffusion practical! Quick notes on Framepack paper.
Paper Review - Pinal for De novo Protein Design
Quick notes on Pinal
Paper Review - Audio-Visual Related Research (WIP)
A survey on Audio-Visual Research. Encrypted with password.
Implementing RAG for Code Library Documentation
I tried to implement RAG for Code Library Documentation. This note help me to remind the important steps in setting up a RAG.
Evaluating Protein Transfer Learning with TAPE
Tasks Assessing Protein Embeddings (TAPE) is a benchmark designed to evaluate semi-supervised learning on protein sequences.
Paper Review - Modality Gap and Alignment in Multi-modal Contrastive Learning
Contrastive learning is a popular self-supervised learning technique that has shown remarkable success in training deep neural networks. The core idea behind contrastive learning is to learn representations that are not only discriminative but also invariant to various transformations. This is achieved by contrasting positive and negative samples in the embedding space.
Notes on Score-Based Generative Models
My personal notes for studying diffusion models. Watching Dome's youtube video to learn.
Paper Review - PDAE, DisDiff and InfoDiffusion
Literature review on Unsupervised Representation Learning in diffusion models.
Paper Review - ColorPeel
An interesting paper from ECCV2024. It talks about the color and shape disentanglement on Text-to-Image models. The solution is simple yet effective.