Theory and Concepts

All theories and concepts of machine learning are found here.

Concept Learning and General to Specific Ordering-Part(5)

A Quick Recap Hello everyone and welcome! In our previous post, we talked about the first algorithm that uses the “more-general-thank-or-equal-to” operation to smooth out the search in the hypothesis space: Find-S Algorithm. As a reminder, below you can see the steps in this algorithm: Like all the other algorithms, and I mean it when …

Concept Learning and General to Specific Ordering-Part(5) Read More »

Concept Learning and General to Specific Ordering-Part(4)

A Quick Recap on our Last Post In our last post, we talked about the more-general-than-or-equal-to operation, which we denoted with ≥g and we said that in order for hypothesis hj to be considered more general than or equal to hypothesis hk, the following has to hold: Today, we will talk about a famous algorithm that can …

Concept Learning and General to Specific Ordering-Part(4) Read More »

Concept Learning and General to Specific Ordering-Part(3)

General-to-Specific Ordering of Hypotheses In the last post, we said that all concept learning problems share 1 thing in common regarding their structure, and it is the fact that we can order the hypotheses from the most specific one to the most general one. This will enable the machine learning algorithm to explore the hypothesis …

Concept Learning and General to Specific Ordering-Part(3) Read More »

Concept Learning and General to Specific Ordering-Part(1)

Introduction If we really wanted to simplify the whole story behind “Learning” in machine learning, we could say that a machine learning algorithm strives to learn a general function out of a given limited training examples. In general, we can think of concept learning as a search problem. The learner searches through a space of hypotheses …

Concept Learning and General to Specific Ordering-Part(1) Read More »