Evolutionary Neuro-Fuzzy Modeling in Parametric Design

Thank you for your interest and for your questions. In every engineering design problem there is a space instantiated by the alternative solutions. It is quite common for these solution spaces to be highly non-linear, with discrete solution intervals, while the available design knowledge could be vague and expressed with formalisms other than analytical relations. Considering the above, we decided that the optimal design solution must by searched by using a non-gradient based heuristic algorithm, that could avoid local extremes in the solution space, while having the possibility of balancing between speed and robustness. Several techniques have been tested in the problem of oscillating conveyors’ design. To mention a few of them: ant colonization, simulated annealing, tabu search, memetic algorithms, pattern search etc. The results show that GAs were classified somewhere in the average. Their adjustability in trading-off speed with accuracy and the significant raise of their performance if used in combination with a traditional optimization technique, led as to their deployment. The GA is deployed only for optimization purposes and they do not participate actively in the learning process.
As far as the learning process is concerned, there are many alternative approaches that can be deployed. It is true that Inductive Logic Programming could deliver a design model suitable for re-design (despite the low learning rate). Also other approaches based on hybrid neural networks could be also used. The neuro-fuzzy learning presented in the current work dominated because we considered the following two issues:
a. the fuzzy rules, delivered by the trained ANN, are extracted from elite solutions b. they can be further calibrated rationally in a future re-design.c) the fuzzy rules that model the simplified design model can also be used in a collaborative framework among designers with aggregation of the existing fuzzy sets under a specific aggregation strategy.
Our approach is a part of an innovative research work in the context of an integrated domain-independent parametric design framework and can only be compared to existing approaches if separate modules are considered each time.
I hope that my answers are sufficient enough.

Could you please give values of all parameters (such as population size, mutation rate, etc.) that you used? Thanks.

The optimal solution for the problem of oscillating conveyors was searched with a GA using two different sets of options. The first set was addressed for the initial problem while the second was addressed for the simplified form that was extracted after the neuro-fuzzy approximation. In order to decide which options were most suitable we designed an auto-generator that produced different alternatives for the options to be made for the GA. Each generated setting was evaluated with a metric based on the convergence time and the deviation from the optimal solution.
Analytically the options for the GA deployment are:
| GA for Initial Problem |
GA for Simplified Problem |
|
| Number of inputs |
5 | 3 |
| Population type |
Double vector | Double vector |
| Population size |
10 | 5 |
| Creation function |
uniform | uniform |
| Fitness scaling |
rank | rank |
| Selection function |
Stochastic uniform | Roulette |
| Elite count |
4 | 2 |
| Crossover fraction |
0.7 | 0.9 |
| Mutation function |
Gaussian | Gaussian |
| Mutation scale |
1 | 1 |
| Mutation shrink |
0.5 | 0.5 |
| Crossover function |
Scattered | Heuristic |
| Migration direction |
Both | Forward |
| Migration fraction |
0.2 | 0.2 |
| Migration interval |
20 | 20 |
| Maximum generations |
30 | 30 |
| Stall generations |
10 | 10 |
| Stall time |
180 s | 180 s |

interesting paper to read.but i'am not quite clear about "evolution of the problem under consideration" as one of 4 basic guidelines of your work, which mentioned in the second paragraph on page 3 of pdf version. can you please make clear what it does mean and how your new methodology achieved it?
thanks.

The present approach addresses design as a parametric optimization problem. The optimal solution is extracted by varying a set of design parameters (DPs). Some of these DPs are only used for defining other DPs through associative relations that are critical for the design performance, noted as performance variables (PVs). The designers usually have direct preferences on sets of values only for the PVs. The current approach facilitates: a) the statement of the PVs b) the solution search by applying preferences on target values for the stated PVs and c) the recording of elite values of these PVs during the genetic optimization process.
The GA optimization results in an optimal solution and a set of ‘elite’ values for variable primary and dependent DPs (PVs). This recorded set of values is used for training a neuro-fuzzy network that associates the primary PVs with dependent PVs without any intermediate DPs or associations. The initial design problem is considered as evolved into a simplified fuzzy digraph with two-levels (see figure below).











Although genetic algorithms perform globalised search for optimal solutions, they are computationally expensive and sensitive to the selection of various parameters such as population size, crossover and mutation probabilities. Have you considered using other machine learning techniques such as inductive learning which does not suffer from the above mentioned problems? Have you compared your new method with other techniques currently available?