Thursday, June 08, 2006

Keypoint Matching With Real Frames



































I tried applying the keypoint-matching portion of the SIFT paper to an input image but I did not achieve very good results. I matched two input images to my database of several hundred different soda-can images and typically achieved results as shown in the first picture. This seems to indicate that when a cluttered background is present, matching individual keypoints does not produce reliable results. The second image shows all of the keypoints found in the input image, which is around 400. It appears that keypoints are being generated for each soda-can in the input image but these are not being determined to be the closest-matching keypoints in the scene.

In order to further determine what the problem is, I tried matching a database image with a frame containing exactly the same image of the soda can in the database. Though this is definitely not a way to test a Computer Vision algorithm for classification ability, it gave some indication about why the poor matching results were occurring. Even though the same image was used, not all of the points were matched. This indicates that analyzing the constellation of points is very important when dealing with a cluttered background. Otherwise, the background could have so much variety to it that keypoints arising in it would match better than keypoints in the correct object. Lowe describes in his SIFT paper a process of using clusters of results from a generalized Hough Transform. Although Lowe achieved good matching results using just his keypoint matching algorithm, he used high-resolution images where the keypoints within the objects in question were numerous and apparently more distinguishable from the background, as seen with a book-matching example at this link: http://www.cs.ubc.ca/~lowe/keypoints/

The next step that I take might be to implement the generalized Hough Transform that Lowe mentions, followed by a pose-estimation. One concern I have is that there are not enough keypoints that can be matched to a database of images. In an earlier blog posting, I showed matching results from comparing high-resolution images to low-resolution images that were scaled-down and oriented differently. These results showed that sometimes there were no keypoint matches between different scales of soda cans. If I have to add many different soda-can scales as well as orientations to my database of images, then the matching algorithm might become prohibitively inefficient and the accuracy level might drop even lower.

I might try using PCA-SIFT to extract keypoints. This algorithm replaces the "smoothed-histogram" that Lowe uses in his keypoint creation stages with PCA (principal component analysis). The PCA-SIFT keypoints are supposedly better at handling noisy images but are more prone to localization error. I was also thinking about using the features described in the Video Google paper, but there is no indication as to how efficient the computation of the "visual words" is. The Video Google paper apparently assumes that the "visual words" are already computed in a video before objects are classified.

Perhaps a long-term solution to object detection using mobile robots should be to simply detect the presence of an object with no regard as to what type of object it is. Objects of a certain size, color, dimension etc. could then be inspected more closely where some SIFT variation could be applied. Perhaps eventually an entire scene could be constructed into a 3D model and while this process is taking place, some easy to recognize objects could be classified before the entire 3D reconstruction completes.

I think that for now, I will implement the generalized Hough Transform and the other stages mentioned in Lowe's SIFT paper and see under what conditions soda cans can be recognized well. I will then be able to better determine if enough keypoints are being generated. I will also be able to determine where Adaboost fits in the detection/recognition process.

68 Comments:

Blogger va2 said...

Do you known how to use hough to identify cluster Keypoint, I mean there are 4 parameters of each Keypoint(x,y,mag,scale) how to use them in hough,Lowe do not explain it clearly,if you have some paper about it please send it to me (tangzhenyu119@hotmail.com) thank you very much!

2:53 AM  
Blogger va2 said...

This comment has been removed by a blog administrator.

2:56 AM  
Blogger TCA 2006 said...

You may be interested in "Robot Madness for Geeks" a blog you can get to by following the link on the right hand side of my page, TCA2006.

TCA

3:31 AM  
Blogger Kurt A. Tasche said...

Here are some great articles on box gold live membership x

11:16 PM  
Blogger bernard n. shull said...

i did a little research after you told me about your "thing", and if you want a way to make more money using your your blog you can enter this site: link. bye.

8:12 AM  
Blogger andresuchitra said...

Hi fred,

My name is Andre. I am currently having a project which is quite similar to your blog posts ( about feasibility-study of color keypoints).

This topic is totally , wholly , new for me. I am starting to learn basic about digital image and about feature or keypoints.
Do you have any recommendation about the book AND the paper that give me basic idea about keypoints in digital gray/color image?

I really need your suggestion.

Thanks for the help

Andre

10:07 PM  
Blogger shiv said...

Hi, Your blog seems to be interesting to me. I have few questions can you please answer me.
1. What is this Key points means here. i know the algorithm to generate keypoints but i want to know what exactly keypoints in an image means and what kind of the pixels are considered as keypoints.

2. I am trying to do object recognition using Hough transform do you suggest and nice paper for the implementation

Please reply at nshamshiva@gmail.com
thanks in advance

6:07 PM  
Blogger 奕玲 said...

thx u very much, i learn a lot

4:42 AM  
Blogger SHYAM said...

Heya¡­my very first comment on your site. ,I have been reading your blog for a while and thought I would completely pop in and drop a friendly note. . It is great stuff indeed. I also wanted to ask..is there a way to subscribe to your site via email?







Function Point Estimation Training

4:43 AM  
Blogger Kathiresan Muthu said...

Thanks for sharing the useful information on the blog and its really understandable,
Besant Technologies Reviews

8:37 PM  
Blogger hari m said...

Thanks for sharing the useful information on the blog and it is really amazing.

QTP Training in Chennai

1:16 AM  
Blogger Emi Jackson said...

Hi, Thanks for sharing this valuable blog.I was really impressed by reading this blog. I did HTML5 Courses in Chennai at reputed HTML5 Training Institutes in Chennai. This is reslly useful for me to make a bright future in designing field.

5:47 AM  
Blogger Jenny Peter said...

Nice discussion to discuss about know lots of things.
Loadrunner Training in Chennai | QTP Training in Chennai | QTP Training in Chennai

5:05 AM  
Blogger mathew delport said...

SEO Training in Chennai

Thanks for sharing this information. SEO is one of the digital marketing techniques which is used to increase website traffic and organic search results. If anyone wants to get SEO Training Chennai visit FITA Academy located at Chennai. Rated as No.1 SEO Institutes in Chennai.

SEO Training in Chennai | SEO Training Center in Chennai


11:11 PM  
Blogger rebeka christy said...

Really awesome blog. Your blog is really useful for me. Thanks for sharing this informative blog. Keep update your blog.

Regards..
Software Testing Training in Chennai

11:27 PM  
Blogger Emi Jackson said...

Cloud computing is storing and accessing the large data sets over the internet instead of your PC computer. So that you can manage the data and program anywhere through the internet.
Regards..
Cloud Computing Training Chennai

4:58 AM  
Blogger Shashaa Tirupati said...

That is an informative post. Thank you so much.
Shashaa
HTML5 Training in Chennai | HTML5 Training in Chennai

6:35 AM  
Blogger Jesica Paul said...

Excellent post!!! Java is most popular and efficient programming language available in the market today. It helps developers to create stunning desktop/web applications loaded with stunning functionalities. Best JAVA Training in Chennai | JAVA Course in Chennai

11:18 PM  
Blogger Rahul said...

I have been following your posts regularly. It is very informative that I share it with my students.
QTP Selenium Training

3:27 AM  
Blogger Rahul said...

Hello Admin, thank you for the informative post. At Fita academy, we provide the best IT trainings for various courses. You can check our Fita Chennai review page to know more about our quality and standards.

11:06 PM  
Blogger Raksha said...

Hello Admin, thank you for the article. It has helped me during my Java training in Chennai. Fita academy is a Java training institutes in Chennai that provides training for interested students. So feel free to contact us to join our Java J2EE training institutes in Chennai.

1:46 AM  
Blogger Harshita said...

Wow, brilliant article on dot net training in Chennai that I was searching for. Helps us a lot in referring at my dot net training institutes in Chennai. Thanks a lot. Keep writing more on dot net training Chennai, would love to follow your posts and refer to others in dot net training institute in Chennai.

4:48 AM  
Blogger Melisa said...


Thanks for sharing this pretty post to our knowledge, SAS is a program that assists to retrieve, managing and uploading the data & simply it’s an integration system of software for performing these actions, thanks for taking your time to discuss about this topic.
Regards,
sas training in Chennai|sas course in Chennai

4:07 AM  
Blogger Srishthi B said...

That is a brilliant article on dot net training in Chennai that I was searching for. Helps us a lot in referring at our dot net training institute in Chennai. Thanks a lot. Keep writing more on dot net course in Chennai, would love to follow your posts and refer to others in dot net training institutes in Chennai.

5:13 AM  
Blogger varshini devi said...

I am reading your post from the beginning, it was so interesting to read & I feel thanks to you for posting such a good blog, keep updates regularly.
Regards,
ccna training in Chennai|ccna training institute in Chennai|ccna institutes in Chennai

3:57 AM  
Blogger Rohit P said...

that was excellent information

thanks author

get training on seo , both online and offline training are provided
market best seo tips and techniques are shared
seo training in bangalore

3:32 AM  
Blogger Anna said...

Great and Useful Article.

Online Java Training | Online Java Training

2:15 AM  
Blogger Haritha said...

Your post is really awesome. Thank you for taking your own time to provide us this valuable informative blog which makes me to enrich my knowledge in a better way

SAS Training in Chennai

3:48 AM  
Blogger Priscilla said...


Thanks a lot for all your valuable article! We are really happy about the your...
SAP Training in chennai

1:54 AM  
Blogger Rubika Sathish said...

Thank you for taking the time to provide us with your valuable information. We strive to provide our candidates with excellent care.As always, we appreciate your confidence and trust in us...!!! SAP Training in Chennai


11:08 PM  
Blogger Nainika Joseph said...


I have been following you for a couple of months now but this is my first time commenting on a blog post. Thank you for sharing your knowledge and experience with us. Keep up the good work. Already bookmarked for future reference.

SAP training in Chennai

7:01 AM  
Blogger rakesh said...

Thanku for sharing..
SAS Institute introduced the SAS Certified Professional Program,training proper understanding of how the SAS software works. Among the five certification programs that SAS Institute has come up with, SAS training can be considered as the entry point into the big data and the data analytics industry.
SAS online training in hyderabad

10:06 PM  
Blogger Maani kamili said...

Wow.. Thanks much for sharing.. My friend also recommended you so that i can have a helping hand to make my blog as effective as possible.

Digital marketing company in Chennai


2:52 AM  
Blogger Aashi siva said...

Excellent goods from you, man. I’ve understand your stuff previous to and you’re just too excellent. I actually like what you’ve acquired here, certainly like what you are stating and the way in which you say it. You make it enjoyable and you still take care of to keep it sensible. I can not wait to read far more from you. This is actually a tremendous site..

Corporate Training in Chennai

3:38 AM  
Blogger Abiya Carol said...

Great post! I am actually getting ready to across this information, It's very helpful for this blog.Also great with all of the valuable information you have Keep up the good work you are doing well.

PPC Services in Chennai

5:19 AM  
Blogger Abiya Carol said...

Such a great articles in my carrier, It's wonderful commands like easiest understand words of knowledge in information's.

Branding Services in Chennai

1:46 AM  
Blogger Girija Manikandan said...

This blog is having the general information. Got a creative work and this is very different one. We have to develop our creativity mind. This blog helps for this. Thank you for this blog. this is very interesting and useful.
PPC Services Chennai

5:51 AM  
Blogger Rakesh S said...

Keypoint matching real nice ..
Hadoop training in hyderabad.All the basic and get the full knowledge of hadoop.
hadoop training in hyderabad

10:34 PM  
Blogger Abni said...



Really awesome blog. Your blog is really useful for me. Thanks for sharing this informative blog. Keep update your blog.


Function Point Estimation Training

9:53 PM  
Blogger Giri Mani 2 said...

This blog explains the details about changing the ways of doing that business. That is understand well and doing some different process. Provides he best output of others. Thanks for this blog.
Digital Marketing Company in Chennai

5:28 AM  
Blogger Sowmiya said...

ya it is really i had a fun and auspicious time by reading your blog thus it makes me to be proud to get many more credentials. thus i had a good time with your blog it attracts me with large types of collections.

Android Training in Chennai

1:37 AM  
Blogger Sathya G said...


Superb i really enjoyed very much with this article here. Really its a amazing article i had ever read. I hope it will help a lot for all. Thank you so much for this amazing posts and please keep update like this excellent article.thank you for sharing such a great blog with us. expecting for your updation.
Android training in chennai

4:25 AM  
Blogger deeksha said...

This blog explains the details about changing the ways of doing that business. That is understand well and doing some different process. Provides he best output of others.

Best Informatica Training Institute in Chennai

3:34 AM  
Blogger deeksha said...

This blog is very well done and it is very much interesting too thanks for sharing these information it is very well done.


Informatica Training in Chennai

4:50 AM  
Blogger deeksha said...

your framework concepts are really nice and i got more information from your blog thus it is really good and very well done.


ccna Training in Chennai

9:45 PM  
Blogger for IT the said...

I have read your blog its very attractive and impressive. I like it your blog.

Java Training in Chennai Core Java Training in Chennai Core Java Training in Chennai

Java Online Training Java Online Training Core Java 8 Training in Chennai Core java 8 online training JavaEE Training in Chennai Java EE Training in Chennai

10:25 PM  
Blogger for IT the said...

Java Training Institutes Java Training Institutes JMS Training Institutes in Chennai JMS Training Institutes in Chennai | JSP Training Institutes in Chennai | MicroServices Training Institutes In Chennai Java MicroServices Training Institutes In Chennai

10:25 PM  
Blogger for IT the said...

Hibernate Online Training Hibernate Online Training Hibernate Training in Chennai Hibernate Training in Chennai Java Online Training Java Online Training

Hibernate Training Institutes in ChennaiHibernate Training Institutes in Chennai Java Online Training Java Online Training Java Online Training Java Online Training

10:26 PM  
Blogger Pricilla Prasanth said...

I have own car so now I am back out there trying to show him how to do car repairs. Your blog is an excellent source of info, thanks.

bike spa services in mumbai
house cleaning services in mumbai
car wash services in mumbai

4:34 AM  
Blogger Shalini said...

Such a great articles in my carrier, It's wonderful commands like easiest understand words of knowledge in information's.

seo company in chennai

3:03 AM  
Blogger skartec seo said...

Great article. Thanks Suresh. http://skartecedu.in

10:59 PM  
Blogger Padhma said...

I have definitely picked up anything new from right here. I did however expertise a few technical points using this site, since I experienced to reload the web site a lot of times previous to I could get it to load correctly.
Back to original

3:36 AM  
Blogger Priya said...

Wonderful bloggers like yourself who would positively reply encouraged me to be more open and engaging in commenting.So know it's helpful.

ielts coaching in Chennai

5:09 AM  
Blogger K Suresh said...

Join the Best Digital Marketing Course in Chennai

Check out SKARtec Digital Marketing Academy

11:51 AM  
Blogger Shalini said...

Superb. I really enjoyed very much with this article here. Really it is an amazing article I had ever read. I hope it will help a lot for all. Thank you so much for this amazing posts and please keep update like this excellent article.thank you for sharing such a great blog with us. expecting for your.

seo company in india

9:39 PM  
Blogger onlinetrainings expert said...

This comment has been removed by the author.

11:29 PM  
Blogger tessa tessa said...

Being new to the blogging world I feel like there is still so much to learn. Your tips helped to clarify a few things for me as well as giving..

Web Design Company in Chennai

8:13 PM  
Blogger sathya said...

Everything is fine, am happy about your blog. Thanks admin for sharing the unique content, you have done a great job I appreciate your effort and I hope you will get more positive comments from the web users.

Hadoop Training in Chennai

9:49 PM  
Blogger Jessica George said...

Superb explanation & it's too clear to understand the concept as well, keep sharing admin with some updated information with right examples.Keep update more posts.

SEO Company in India|Digital Marketing Company in Chennai

10:41 PM  
Blogger aarthi rengarajan said...

This is an awesome post. Really very informative and creative contents. These concept is a good way to enhance the knowledge. Excellent post. Our Digital Marketing Training is tailored for beginners who want to learn how to stand out digitally, whether it is for their own business or a personal brand.

Digital Marketing Course
Digital Marketing Online Course
Digital Marketing Course Online
Online Digital Marketing Course
Digital Media Marketing Course
Digital Marketing Course Syllabus
Marketing Digital Course
SEO Digital Marketing Course
Best Digital Marketing Course
Online Course in Digital Marketing
Digital Marketing Training Course
Certificate Course in Digital Marketing
Digital Marketing Course Description
Digital Marketing Course India
Digital Marketing Training
Digital Marketing Training Online
Digital Marketing Training Courses
Digital Marketing Strategy Training
Digital Marketing Training Courses Online
Digital Marketing Training Course
Digital Marketing Online Training
Digital Marketing Training Institute Reviews
Learn Digital Marketing
How To Learn Digital Marketing
Learn About Digital Marketing
Learn Digital Marketing Online

2:25 AM  
Blogger Melba henry said...

Great sharing. Its very interesting and informative blog. keep sharing. thank you.
Android Training in Chennai
Selenium Training in Chennai
Hadoop Training in Chennai

2:22 AM  
Blogger Mahalya sree said...

Wow.. Thanks much for sharing.. My friend also recommended you so that i can have a helping hand to make my blog as effective as possible.
Architectural Firms in Chennai
Architects in Chennai

2:20 AM  
Blogger Rohan Singh said...

That is understand well and doing some different process. Provides he best output of others. Thanks for this blog.Thanks for the sharing.
Web Designing training in noida | SAS Summer Training in Noida

5:48 AM  
Blogger Merlin Maarit said...


It is very helpful for me. Keep blogging like this.

Analytics Company

US IT Staffing Agency

US IT Staffing

US Staffing Services

Permanent hire

Contract hire

Temporary to Permanent hire

12:13 PM  
Blogger Sowmiya said...

Interesting blog which attracted me more.Spend a worthful time.keep updating more.
MSBI Training in Chennai

4:56 AM  
Blogger sandhosh said...


Really Good blog post.provided a helpful information.keep updating...
Digital marketing company in Chennai

9:19 PM  
Blogger Karthi Keyan said...


very very amazing explaintion....many things gather about yourself...yes realy i enjoy it

Interesting blog post.This blog shows that you have a great future as a content writer.waiting for more updates...
Digital Marketing Company in India

Digital Marketing Services in India

Digital Marketing Agency in India

3:39 AM  
Blogger sandhosh said...

superb.....blog is much interesting which engaged me more.Spend a worthful time.keep updating more.
SEO Company in India
SEO Services in India
SEO Companies in India
SEO Company India
SEO Services India
SEO Companies India

11:06 PM  

Post a Comment

<< Home