Nov 3, 2022Similarity to Probability — Part I: Visual Word Embedding for OCR Post CorrectionIn this post, I will revisit in more detail our previous work that uses human-inspired likelihood revision or similarity to probability [Blok et al. 2003] to re-rank or score any word or text fragment based on the semantic relation to an external context. We will use the most popular Semantic…Probability21 min readProbability21 min read
May 1, 2022ICRL2022 — Interesting PapersIn this short blog post, I will highlight a couple of interesting ideas presented in ICLR 2022 in both 🖼️ Computer Vision and 📖 Natural Language Processing. Table of Contents 📖 Finetuned Language Models are Zero-Shot Learners 🧩 🖼️ BEiT: BERT Pre-Training of Image Transformers 🧩 🖼️ SimVLM: Simple Visual Language Model…Machine Learning8 min readMachine Learning8 min read
Apr 20, 2022Review: Deep Learning for Sentence Semantic SimilarityA very brief introduction to previous and current trends in sentence semantic similarity with deep learning. Table of Contents ⚀ Convolutional Neural Network ⚁ Long Short Term Memory ⚂ Attention Mechanism ⚃ Transformer ⚄ BERT ⚅ BERT unsupervised The general word embedding i.e., count based word embedding models (e.g., word…Semantic Similarity31 min readSemantic Similarity31 min read
Mar 28, 2022Paper Summary: BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationIn this blog post, I will discuss this vision and language paper BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation, which is the newest Feb-2022 model and current state-of-the-art in different languages and visions tasks. …Machine Learning15 min readMachine Learning15 min read
Mar 27, 2022Word to Sentence Visual Semantic Similarity for Caption Generation: Lesson learnedIn this blog post, I will share with you some insight and lessons learned from our recent research idea that should work in theory (i.e., BERT+GloVe), but in practice, it doesn’t work in our scenario. Recent state-of-the-art progress in pre-trained vision and language and image captioning models relies heavily on…Machine Learning15 min readMachine Learning15 min read
Mar 9, 2022Paper Summary: UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive LearningIn this post, I will outline some important aspects of this language and vision paper. In a bird’s view, the authors tried to unify different modalities,(language and vision) in the same semantic space, to achieve a generalized model that performed well on different language and vision tasks such as visual…Machine Learning14 min readMachine Learning14 min read
Feb 20, 2022An application for Semantic Relatedness: Post OCR CorrectionIn this post, I will discuss our work that uses semantic relatedness measure, as a post-processing based method, to improve text recognition in the wild (a.k.a OCR in the wild). …Ocr11 min readOcr11 min read
