Soft computing is a set of algorithms, including neural networks, fuzzy logic, and evolutionary algorithms. These algorithms are tolerant of imprecision, uncertainty, partial truth and approximation. It is contrasted with hard computing: algorithms which find provably correct and optimal solutions to problems.
Soft Computing includes:
Fuzzy Logic
use fuzzy rules and approximate reasoning
a popular analogy: human knowledge
Neural Networks
network of massively connected nodes
a popular analogy: neuron structure in brain
Genetic Algorithms
Derivative-free optimization
a popular analogy: biological evolution
Probabilistic Reasoning
Incorporates uncertainty in predicting future events
a popular analogy: random action of a human
Fuzzy Logic Systems
Fuzzy logic was first developed by L.A. Zadeh in 1960’s to extend conventional (binary) crisp logic to make it suitable to incorporate knowledge and mimic human-like approximate reasoning.
Two-state (bivalent) crisp logic uses two quantities: true (T) and false (F) as truth values.
However:
Real-life situations are usually characterized by ambiguity and partial truth.
cannot always assume two crisp states T and F with a crisp line dividing them.
Terminology:
Crisp: only T or F
Fuzzy: Partial membership is possible (very true? not very true?)
Membership Function
A fuzzy set may be represented by a membership function, which gives the grade (or degree) of membership within the set, of every element of the universe of discourse.
Think of universe as a as set that contains every set in the context.
A fuzzy set A may be represented as a set of ordered pairs:
A={(x,μA(x));x∈X,μA(x)∈[0,1]}
The membership function μA(x) maps the elements of the universe of discourse onto numerical values in the interval [0, 1].
The membership function μA(x) represents the grade of possibility (not probability) that an element x belongs to the fuzzy set A.
μA(x)=1 => x is definitely an element of A.
μA(x)=0 => x is definitely not an element of A.
μA(x)=0.2 => the possibility that x is an element of A is 0.2.
Symbolic Representation
If the universe of discourse is discrete with elements xi, then a fuzzy set A may be symbolically represented with a “formal series”
Example: Discrete Universe: Suppose that the universe of discourse X denotes the driving speeds in a highway. Consider the fuzzy sets A and B are given by:
Fuzzy state Slow (A): A=1.0/40+1.0/50+0.8/60+0.4/80+0.1/100
Fuzzy state Moderate (B): B=0.6/50+0.8/60+1.0/70+1.0/80+1.0/90+1.0/100
Example: Discrete Universe: Suppose that the universe of discourse X denotes the driving speeds in a highway. Consider the fuzzy sets A and B are given by:
Fuzzy state Slow (A): A=1.0/40+1.0/50+0.8/60+0.4/80+0.1/100
Fuzzy state Moderate (B): B=0.6/50+0.8/60+1.0/70+1.0/80+1.0/90+1.0/100
##The fuzzy intersection of A and B are as follows:
A∩B=0.6/50+0.8/60+0.4/80+0.1/100
Generalized Fuzzy Complement
A generalized complement operation, denoted by C : [0, 1] → [0, 1], should satisfy the following axioms:
Boundary conditions
C(∅)=X and C(X)=∅, where X is the universe of discourse
Non-increasing:
If μA(x)<μB(X) then C(μA(x))≥C(μB(x)) , and vice versa
Involutive
C(C(A))=A
T-norm (Generalized Intersection)
The intersection of two fuzzy sets A and B is given by an operation T which maps two membership functions to:
μA∩B(x)=T(μA(x),μB(x))
Let a=μA(x), b=μB(x).
The t-norm operation or generalized intersection may be represented by T(a,b) or more commonly aTb.
The height (also called modal grade) of a fuzzy set is the maximum value of its membership function.
hgt(A)=x∈XsupμA((x))
also called the modal element value, or simply modal point.
Support Set of a Fuzzy Set
A crisp set containing all the elements (in the universe) whose membership grades are greater than zero.
S={x∈X∣μA(x)>0}
Alpha-cut of a Fuzzy Set
The α-cut of a fuzzy set A is the crisp set denoted by Aα formed by the elements of A whose membership function grades are greater than or equal to a specified threshold value α ∈ [0, 1].
Aa={x∈X∣μA(x)≥α},α∈[0,1]
Three Measures of Fuzziness
A measure of fuzziness of a fuzzy set A in the universe X defines the closeness of its membership function μA to the most fuzzy grade (0.5).
Closeness to grade 0.5 (A1),
A1=∫x∈Sf(x)dx
where
S denotes the support set
f(x)=μA(x) for μA(x)≤0.5
f(x)=1−μA(x) otherwise
Distance from 1/2−cut (A2),
A2=∫x∈X∣μA(x)−μA1/2(x)∣dx
Inverse of distance from the complement (A3).
A3=2∫x∈X∣μA(x)−0.5∣dx
can be derived to ∫x∈X∣μA(x)−μAˉ(x)∣dx
Relationship Between Different Measures of Fuzziness
A1=A2=21(S∗1−A3)
Relations
For boolean relation in crisp sets and binary logic:
the relation is equivalent to the logical expression (proposition)
Can be proved using truth table
E.g. Consider a fuzzy logic proposition A with membership function μA.
μA may be taken to represent the degree of validity of the relation A is True.
1−μA represents the degree of validity of the fuzzy relation A is NOT True.
Cartesian Product of Fuzzy Sets
Consider a fuzzy set A1 defined on the universe X1 and a second fuzzy set A2 defined on a different (independent, orthogonal) universe X2.
The Cartesian product A1×A2 is the fuzzy subset of the Cartesian space X1×X2. Its membership function is given by:
Consider a mapping function f:X→Y
Let A be a fuzzy set on X
A=x1μA(x1)+x2μA(x2)+⋯+xnμA(xn)
The Extension Principle states that the image of A under mapping f(⋅) is expressed on Y
B=f(A)y1=y1μA(x1)+y2μA(x2)+⋯+ynμA(xn), where =f(x1),y2=f(x2),…,yn=f(xn)
presuming that the function f is a one-to-one mapping.
If f is a many-to-one mapping, i.e., ∃x1=x2 such that y1=f(x1)=f(x2)=y2, Then μB(y)=max[μA(x1),μA(x2)].
Given the relation R defined by R=∫X×Y(x,y)μR(x,y)
The first projection is a fuzzy set that results by eliminating the second set Y of X×Y by projecting the relation on X.
Projection 1:
R1=∫XxμR1(x),μR1(x)=y⋁max[μR(x,y)]
The second projection is a fuzzy set that results by eliminating the first set X of X×Y by projecting the relation on Y.
Projection 2:
R2=∫YyμR2(y),μR2(y)=x⋁max[μR(x,y)]
The total projection is a combined projection over the spaces X and Y and is defined by
A typical fuzzy logic system’s knowledge base is composed of a series of if-then rules.
Each rule is a fuzzy relation employing the (if-then) fuzzy implication.
When all individual rules (relations) are aggregated (executed), they result in one fuzzy relation represented by a fuzzy set, say K, and a multi-variable membership function.
In a fuzzy decision making process, the rule base K is first collectively matched with the available data.
Suppose that the available data (context) is denoted by the fuzzy set (or relation) D and the inference (action) is denoted by a fuzzy set (or relation) I.
Then, the compositional rule of inference states that
I=D∘K,∘: “composed with"
The membership function of the inference I (also called decision, or action) is determined as
μI=ysup{min[μD,μK]}
where the inference I is the output of the knowledge base decision making system.
This is known as the sup-min (or max-min) composition.
Another method to compute the inference I is through the sup-product composition.
μI=ysup{μD⋅μK}
Fuzzy Reasoning
Fuzzy reasoning, also known as approximate reasoning (AR), is an inference procedure that derives conclusions from a set of if-then rules.
Fuzzy reasoning is basically the extension of the well known composition of elements and functions.
Let us assume that F is a fuzzy relation on X×Y.
Let A be a fuzzy set in X.
To obtain the resulting fuzzy set B, we first construct a cylindrical extension of A, C(A).
The inference of C(A) and F leads to the antecedent of the projection of C(A)∩F.
This leads to the fuzzy set B.
C(A)∩F(x,y) is known as the composition operator R1∘R2
Where C(A)=R1, ∘ is the generalized operator (∩ In this case), R2=F(x,y)
Modus Ponens (MP)
The rule of inference in conventional logic is modus ponens.
Modus Ponens leads to inference of truth of a proposition B from the truth of A and the implementation A → B.