Blog posts
2026
Information Theory - Chapter 1: Entropy
Published:
This chapter introduce the definition of entropy, joint entropy, conditional entropy, relative entropy(divergence), conditional divergence, mutual information and conditional mutual information.
Information Theory - Chapter 2 Property of Entropy
Published:
In this chapter, we will further discover the properties of Entropy.
Information Theory - Chapter 3 Important Inequality
Published:
In this section, we will introduce some important inequalities (data processing inequality and fano’s inequality).
Information Theory - Chapter 4 Asympotic Equipartition Property(AEP)
Published:
Informal statement of AEP: Let $X_1,\cdots,X_n$ be i.i.d. Then almost all realizations $(x_1, \cdots,x_n)$ have probability close to $2^{-nH(X)}$. The set of all these realizations is called the typical set.
Information Theory - Chapter X Lempel-Ziv coding
Published:
This chaper is to talk about LZ78 and its asympotic optimaling.
Information Theory - Chapter X+1 Shannon-Fano-Elias Codes and Arithmetic Codeing
Published:
This chapter we will introduce Shnnon-Fano-Elias codes and arithmetic coding.
Information Theory - Chapter X+3 Slepian-Wolf Coding
Published:
Slepian-Wolf Coding is a fixed-length and almost lossless compression with some side information, which is to deal with the sequence of the source.
Information Theory - Chpter X+5 Achievability of BSC(p)
Published:
Informal discussion of Shannon’s channel coding theorem for Binary Symmetry Coding.
Information Theory - Chapter X+6 Information Capacity
Published:
In this chapter, we will introduce the information capacity of the channel.
PyTorch Implementation of Convolutional Neural Network
Published:
PyTorch Implementation of Convolutional Neural Network
PyTorch Implementation of Softmax Multi-Classifier
Published:
PyTorch Implementation of Softmax Multi-Classifier
ABY - A Framework for efficient Mixed-Protocol Secure Two-Party Computation 阅读笔记 Part I
Published:
ABY - A Framework for efficient Mixed-Protocol Secure Two-Party Computation 阅读笔记 Part I
ABY - A Framework for efficient Mixed-Protocol Secure Two-Party Computation 阅读笔记（Arithmetic部分）
Published:
今天看了秘密分享架构中的ABY架构，尤其看了Arithmetic sharing部分，对于该秘密分享机制下的加法与乘法的计算有了一定的了解，而且了解了如何通过Pailler同态加密方法产生c=axb的三元组。但是对于OT-Base产生三元组的方法不太了解，明天会对非对称加密体系，安全分享公钥的方法还有Diffie-Hellman算法进行学习以求更加熟悉OT-Base办法
大二上学期滴流水账
Published:
虽然说学期开始的时候就预感到这是最累的一个学期，但是还是没有没有想到这个学期会有那么的累。压缩的教学周，消失的复习周，消失的国庆假期，大创院、校级中期答辩、ICPC、MIT项目的ddl全部堆积在期末使得本不充足的睡眠雪上加霜。（相形之下，五天早八似乎已经微不足道了哈哈哈。不论如何，最为困难的日子应该已经过去了（吧）希望2021年变得更好！