Nov 3, 2022Similarity to Probability — Part I: Visual Word Embedding for OCR Post CorrectionIn this post, I will revisit in more detail our previous work that uses human-inspired likelihood revision or similarity to probability [Blok et al. 2003] to re-rank or score any word or text fragment based on the semantic relation to an external context. We will use the most popular Semantic…Probability21 min readProbability21 min read
May 1, 2022ICRL2022 — Interesting PapersIn this short blog post, I will highlight a couple of interesting ideas presented in ICLR 2022 in both 🖼️ Computer Vision and 📖 Natural Language Processing. Table of Contents 📖 Finetuned Language Models are Zero-Shot Learners 🧩 🖼️ BEiT: BERT Pre-Training of Image Transformers 🧩 🖼️ SimVLM: Simple Visual Language Model…Machine Learning8 min readMachine Learning8 min read
Apr 20, 2022Review: Deep Learning for Sentence Semantic SimilarityA very brief introduction to previous and current trends in sentence semantic similarity with deep learning. Please refer to this GitHub for the related official repository for each paper. Table of Contents ⚀ Convolutional Neural Network ⚁ Long Short-Term Memory ⚂ Attention Mechanism ⚃ Transformer ⚄ BERT ⚅ BERT unsupervised …Semantic Similarity31 min readSemantic Similarity31 min read
Mar 28, 2022Paper Summary: BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationIn this blog post, I will discuss this vision and language paper BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation, which is the newest Feb-2022 model and current state-of-the-art in different languages and visions tasks. …Machine Learning15 min readMachine Learning15 min read
Mar 9, 2022Paper Summary: UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive LearningIn this post, I will outline some important aspects of this language and vision paper. In a bird’s view, the authors tried to unify different modalities,(language and vision) in the same semantic space, to achieve a generalized model that performed well on different language and vision tasks such as visual…Machine Learning14 min readMachine Learning14 min read
Feb 20, 2022An application for Semantic Relatedness: Post OCR CorrectionIn this post, I will discuss our work that uses semantic relatedness measure, as a post-processing based method, to improve text recognition in the wild (a.k.a OCR in the wild). …Ocr11 min readOcr11 min read
