Using the Bees Algorithm to optimise a Support Vector Machine for wood defect classification

authors: Pham D. T., Zaidi Muhamad, Massudi Mahmuddin, Afshin ghanbarzadeh, Ebu Bekir Koc

This paper describes a new application of the Bees Algorithm to the optimisation of a Support Vector Machine (SVM) for the problem of classifying defects in veneer wood. The algorithm, which is a swarm-based algorithm inspired by the food foraging behaviour of honey bees, was also employed to select the components making up the feature vectors to be presented to the SVM. The objective of the work was to find the best combination of SVM parameters and data features to maximise defect classification accuracy. The paper presents the results obtained to demonstrate the strengths of the Bees Algorithm as an optimisation tool.

AttachmentSize
BeeSVM.wmv5.8 MB

a pdf file
Afshin's picture
Submitted by Afshin on Fri, 10/08/2007 - 7:30pm.

Weldone Zaidi, nice paper and presentation. As far as I can recall, 93% accuracy is the best achieved acurracy in wood fault detection.

I just wonder why SVM generally gives better classification results than other methods. I mean is it because of it's structure or there are other reasons.

Many thanks,

Afshin


Mr Olivier Dent's picture
Submitted by Mr Olivier Dent on Fri, 10/08/2007 - 7:36pm.

Hi,

How long did it take to carry out your double optimisation procedure? (Remember to specify the machine and software that you used.)

Thanks.

M R O Dent


zaidimuhamad's picture
Submitted by zaidimuhamad on Sun, 12/08/2007 - 10:07am.

Thanks for your question Dr. Dent. Actually it tooks 3495 sec = 58.25 minutes to complete a double optimisation. Software used: Library Support Vector Machine (LIBSVM) version 2.83 and the Bees Algorithm.


zaidimuhamad's picture
Submitted by zaidimuhamad on Sun, 12/08/2007 - 11:21am.

Afshin , thanks for your question,
Actually one of the reason is that Artificial Neural Networks (ANN) use Empirical Risk Minimisation (ERM), while SVMs use a Structural Risk Minimisation (SRM). For more information the comparison between ANN and SVM, visit: http://www.svms.org/anns.html


Mr Olivier Dent's picture
Submitted by Mr Olivier Dent on Sun, 12/08/2007 - 2:52pm.

Thanks for the info, Dr Zaidimuhamad.

Did you use a Pentium and, if so, which version?


Pham's picture
Submitted by Pham on Thu, 16/08/2007 - 1:39pm.

Dr Dent,

We used a Pentium 5 machine. Thanks for your interest.

D Pham.


Ebubekir's picture
Submitted by Ebubekir on Fri, 24/08/2007 - 5:20pm.

Hi,
Well done Zaidi, thats very nice results with this quite difficult data set.
Well, I don't understand the gamma variable representing the bees. Could you explain a bit more please?
Best regards,
Ebubekir


Pham's picture
Submitted by Pham on Wed, 29/08/2007 - 11:47am.

Hi Ebubekir,
I am responding in the place of Zaidi who, I believe, is away collecting nectar in sunny Malaysia. You can imagine poor Zaidi sweating hard there.
Gamma is one of the two variables we are trying to find the optimum value for. The other variable is C.
Together, a given pair (gamma, C) represents a particular bee.
I trust this is now clear to you and other readers of our paper.
Best wishes.
DTP.


Comment viewing options

Select your preferred way to display the comments and click "Save settings" to activate your changes.

Who's online

There are currently 0 users and 112 guests online.