Upload
aldon
View
53
Download
1
Embed Size (px)
DESCRIPTION
Nanjing University of Science & Technology. Like to Thank Lu Jian Feng Yang Jing-yu Wang Han. For inviting me to present this course on Pattern Recognition: Statistical and Neural. Nanjing University of Science & Technology. Lecture 1: Introduction. September 14, 2005. Textbooks:. - PowerPoint PPT Presentation
Citation preview
1
Nanjing University of Science & Technology
Like to Thank
Lu Jian FengYang Jing-yu Wang Han
For inviting me to present this course on
Pattern Recognition: Statistical and Neural
2
Nanjing University of Science & Technology
Lecture 1: Introduction
September 14, 2005
3
Today’s Presentation ______________________
Introduce Myself
Proposed Course
Current Research
4
Dr. Lonnie C. Ludeman
Professor Emeritus, College Professor
Klipsch School of Electrical and computer EngineeringNew Mexico State UniversityLas Cruces, New Mexico 88003USA
5
Textbooks:
Fundamentals of Digital Signal Processing,John Wiley, 1968
Random Processes: Filtering, Estimationand Detection, John Wiley, 2003
PHEI 2005 Chinese VersionPattern Recognition: Statistical and Neural,Currently Preparing Manuscript
6
Proposed Course
PATTERN RECOGNITION: Statistical and Neural_________________________________________________
Text: "Pattern Recognition: Statistical and Neural", Lonnie C. Ludeman (Manuscript in progress) Instructor: Dr. Lonnie C. Ludeman, Professor General Description: Statistical pattern classification, supervised and unsupervised
learning, neural networks for pattern recognition, featureselection and extraction, clustering techniques, and syntacticalpattern recognition.
Prerequisites: Probability and random variables
7
Course Topical Outline: 1. Pattern Recognition Overview 2. Statistical Pattern Recognition
Maximum A'posteriori decision rule, Minimum Probability oferror decision rule Bayes decision rule, Neyman PearsonDecision Rule Classifier performance-Risk, Probability oferror, and Receiver Operating Characteristics GeneralGaussian Case, Discriminant Functions, ClassifierPerformance Decision regions and Discriminant functions-linear, nonlinear and generalized linear
3. Training pattern recognizers The perceptron algorithm The potential function algorithm
8
4. Pattern Recognition using Neural NetworksIntroduction to Neural Networks- Basics, Physical Neural NetworksArtificial Neural Networks-McColloch Pitts Model, ActivationFunctions, Continuous Perceptron Training algorithms- Delta rule forsingle layers, Back propagation for multilayer networks, Improvementsto the backpropagaton algorithm, parameter selection and guidelines,and performance evaluation
5. Other classifiers
Functional link nets, Hopfield neural nets, Hammming net classifier,MAXNET classifier, nearest neighbor rules using distance andsimilarities measures,
4. Pattern Recognition using Neural NetworksIntroduction to Neural Networks- Basics, PhysicalNeural Networks Artificial Neural Networks-McColloch Pitts Model, Activation Functions,Continuous Perceptron Training algorithms- Deltarule for single layers, Back propagation for multilayernetworks, Improvements to the backpropagaton algorithm, parameter selection and guidelines, andperformance evaluation
5. Other classifiers
Functional link nets, Hopfield neural nets,Hammming net classifier, MAXNET classifier,nearest neighbor rules using distance and similarities measures,
9
6. Clustering algorithms K-means, ISODATA, Maximin, Hierarchical,Adaptive Resonance Theory, Fuzzy Clustering
7. Syntactic Pattern Recognition 8. Feature selection 9. Data Fusion
10
Current Research Interests:
Clustering of non QuantitativeArchaeological Data
Neural Networks and ClusteringEducational Software
Blind Nonlinear System Identification ofSpeech Signals
11
Clustering of non quantitative data
(A) Nominal or ordinal
(B) Syntactical
(C) Fuzzy
12
Pattern Recognition Educational Software
(A) LCLNET - A neural Network Simulator
(B) LCLCLUSTER - A clustering GUI
13
(A) LCLNET - A neural Network Simulator
1. Train a feedforward neural network2. Test trained network using training and other non-training files3. Change parameters quickly and interactively: Layers , nodes/layer, learning and momentum parameter, nonlinearities, target values, initial conditions4. Create, store, print, and view - Data files, weight files and results5. Provide visual tracking of weight changes For trining by sample and epoch
14
(A) LCLCLUSTER - A Clustering GUI
1. Data selection Interface - directory information
2. Easy Selection of Types of clustering - K-means, Hierarchical, Fuzzy, ART
3. Storage and viewing - of iterative steps and final results
4. Easy changing of parameters- Number of clusters, fuzzy index, and initial conditions
15
GUI for LCLCLUSTER
16
Fuzzy Clustering Results
17
ln()
s(t)
x(t)
1
c sin( ct+ )
d
xln()
s(t)
x(t)
1
c sin( ct+ )
d
x
ln()
s(t)
x(t)
1
c sin( ct+ )
d
x
Non Linear Speech Model
18
Estimate c
x(t)
-1
Bandpass Filter 2 c ± c/2
Estimate dc2
Bandpass Filter 3 c ± c/2
Estimate 1 + s(t)
s(t) ^
^
^ ^
^
^
Estimate c
x(t)
-1
Bandpass Filter 2 c ± c/2
Estimate dc2
Bandpass Filter 3 c ± c/2
Estimate 1 + s(t)
s(t) ^
^
^ ^
^
^
Synthesis of speech signal
19
20
21
22
Summary ______________________
Introduced Myself
Presented Proposed Course
Discussed my Current Research Directions
23
Thank you for your attention ______________________
I am happy to answer any questions.
24
New Mexico
Land of Enchantment