In the last post I introduced Word2vec and presented it using intuitive concepts. in this post I will implement these ideas in python. I will be using the Open American National Corpus (http://www.anc.org/), which consists of roughly 15 million spoken and written words from a variety of sources. Specifically, we will be using the sub…
In this post I will be implementing the Word2vec algorithm with negative sampling from scratch using python. Implementing this from scratch allow to have a better grasp the inner operations of word2vec’s skip-gram and negative sampling approach. For our analysis, we will use the Open American National Corpus (http://www.anc.org/), which consists of roughly 15 million…
Introduction The goal of any classification algorithm is to predict a value c given the value of a vector x of input features. In classification problems, c is a discrete class label, whereas in a regression problem it is a continuous variable. From a probabilistic point of view, the goal is to find the conditional…
In this article I’m going to analyze a marketing database using Principal Component Analysis or PCA. PCA is particularly useful when we are working with data sets that have a lot of variables. These datasets cannot be easily visualized the in its raw format, and hence it is difficult to get a sense of the…
Markov chains is one of the oldest ways to generate quite believable text. Rather than generating text by randomly selecting characters (possible but completely impractical), we use the Markov property that follows the chain of linked events, where what get generated next depends only on what is generated currently. Typically generating text trough, a Markov process…
What is Context free grammar? A Context-Free Grammar (CFG) is a set of rules that define what is and is not a valid sequence of “words” of a language. The rules aren’t limited to the production of text and can be applied in all fields where a fixed number of rules structures the production of…
Text generation is a hot topic right now in the domain of Artificial intelligence. Any advanced artificial intelligence will have the ability to interact with us, humans. And this means the ability to talk our language to understand us and to communicate back to us. Ultimately the IA needs to truly interact with us in…
Now I will start designing the engine of the virtual assistant. This engine will be the central nervous system of ow tool. The first approach that I will follow here is very simple. This approach is summarised in the following diagram. In this design the text to speech convert speech to text. This…
In this post We will be going to set up the system for voice recognition and voice generation. Before delving into the details, lets structure our work space. Lets create a folder structure that will hold our project, but first we need to give a name to our assistant. In my case I will call…
When users interact with internet content it is important, specifically for recommendation systems, to get their feedback. There are mainly 3 ways that are commonly used to gather users feedback on the Internet. In the our case the content scored by the users could be any web entity such as news articles, products, vendors,… 1-…
