Thursday, June 08, 2006

Keypoint Matching With Real Frames



































I tried applying the keypoint-matching portion of the SIFT paper to an input image but I did not achieve very good results. I matched two input images to my database of several hundred different soda-can images and typically achieved results as shown in the first picture. This seems to indicate that when a cluttered background is present, matching individual keypoints does not produce reliable results. The second image shows all of the keypoints found in the input image, which is around 400. It appears that keypoints are being generated for each soda-can in the input image but these are not being determined to be the closest-matching keypoints in the scene.

In order to further determine what the problem is, I tried matching a database image with a frame containing exactly the same image of the soda can in the database. Though this is definitely not a way to test a Computer Vision algorithm for classification ability, it gave some indication about why the poor matching results were occurring. Even though the same image was used, not all of the points were matched. This indicates that analyzing the constellation of points is very important when dealing with a cluttered background. Otherwise, the background could have so much variety to it that keypoints arising in it would match better than keypoints in the correct object. Lowe describes in his SIFT paper a process of using clusters of results from a generalized Hough Transform. Although Lowe achieved good matching results using just his keypoint matching algorithm, he used high-resolution images where the keypoints within the objects in question were numerous and apparently more distinguishable from the background, as seen with a book-matching example at this link: http://www.cs.ubc.ca/~lowe/keypoints/

The next step that I take might be to implement the generalized Hough Transform that Lowe mentions, followed by a pose-estimation. One concern I have is that there are not enough keypoints that can be matched to a database of images. In an earlier blog posting, I showed matching results from comparing high-resolution images to low-resolution images that were scaled-down and oriented differently. These results showed that sometimes there were no keypoint matches between different scales of soda cans. If I have to add many different soda-can scales as well as orientations to my database of images, then the matching algorithm might become prohibitively inefficient and the accuracy level might drop even lower.

I might try using PCA-SIFT to extract keypoints. This algorithm replaces the "smoothed-histogram" that Lowe uses in his keypoint creation stages with PCA (principal component analysis). The PCA-SIFT keypoints are supposedly better at handling noisy images but are more prone to localization error. I was also thinking about using the features described in the Video Google paper, but there is no indication as to how efficient the computation of the "visual words" is. The Video Google paper apparently assumes that the "visual words" are already computed in a video before objects are classified.

Perhaps a long-term solution to object detection using mobile robots should be to simply detect the presence of an object with no regard as to what type of object it is. Objects of a certain size, color, dimension etc. could then be inspected more closely where some SIFT variation could be applied. Perhaps eventually an entire scene could be constructed into a 3D model and while this process is taking place, some easy to recognize objects could be classified before the entire 3D reconstruction completes.

I think that for now, I will implement the generalized Hough Transform and the other stages mentioned in Lowe's SIFT paper and see under what conditions soda cans can be recognized well. I will then be able to better determine if enough keypoints are being generated. I will also be able to determine where Adaboost fits in the detection/recognition process.

25 comments:

andresuchitra said...

Hi fred,

My name is Andre. I am currently having a project which is quite similar to your blog posts ( about feasibility-study of color keypoints).

This topic is totally , wholly , new for me. I am starting to learn basic about digital image and about feature or keypoints.
Do you have any recommendation about the book AND the paper that give me basic idea about keypoints in digital gray/color image?

I really need your suggestion.

Thanks for the help

Andre

shiv said...

Hi, Your blog seems to be interesting to me. I have few questions can you please answer me.
1. What is this Key points means here. i know the algorithm to generate keypoints but i want to know what exactly keypoints in an image means and what kind of the pixels are considered as keypoints.

2. I am trying to do object recognition using Hough transform do you suggest and nice paper for the implementation

Please reply at nshamshiva@gmail.com
thanks in advance

Anonymous said...
This comment has been removed by the author.
Durga IT Solutions said...

Thanks for sharing such a wonderful Post with us. I learnt alot from your post. I am appreciating from you to you will share more

information about it. Please keep sharing. Thanks Alot
Lenovo Service Center in Kukatpally, Hyderabad.
Best Laptop Service Center in Kukatpally, Hyderabad.

educational blogs said...

It’s really a nice and useful piece of information. I am glad that you shared this useful information with us. Please keeps us to date like this .thank you for sharing.

Python corporate training in Nigeria

educational blogs said...

I am so happy after reading your blog. It’s very useful blog for us.

Python Corporate training in Uganda

educational blogs said...

Please continue this great work and I look forward to more of your awesome posts.

Data Science in-house Corporate training in Nigeria

Vijiaajith said...

Nice...
freeinplanttraining

courseforECEstudents

internship-in-

chennai-for-bsc

inplant-

training-for-automobile-engineering-students

freeinplanttraining

for-ECEstudents-in-chennai

internship-for-

cse-students-in-bsnl

application-for-

industrial-training

educational blogs said...

Thanks for sharing this valuable information and we collected some information from this blog.

in-house Corporate training for employees in Nigeria

educational blogs said...

Please continue this great work and I look forward to more of your awesome posts.

in-house training program in Ghana

nash b said...

Nice Blog...
t system placement paper

advantages of package in java

2xwy cable full form

react native developer resume sample

log(a2/bc) + log(b2/ac(c2/ab) is

error: cannot find module '../lib/utils/unsupported.js'

django.core.exceptions.improperlyconfigured: error loading mysqldb module.

infix to postfix python

what is your biggest achievement yahoo answers

toughest pattern programs in c

shree said...

very nice....
inplant training in chennai
inplant training in chennai for it.php
namibia web hosting
norway web hosting
rwanda web hosting
spain hosting
turkey web hosting
venezuela hosting
vietnam shared web hosting



shri said...

nice....
internship in chennai for ece students
internships in chennai for cse students 2019
Inplant training in chennai
internship for eee students
free internship in chennai
eee internship in chennai
internship for ece students in chennai
inplant training in bangalore for cse
inplant training in bangalore
ccna training in chennai


dras said...

very useful...post
python training in chennai
internships in hyderabad for cse 2nd year students
online inplant training
internships for aeronautical engineering students
kaashiv infotech internship review
report of summer internship in c++
cse internships in hyderabad
python internship
internship for civil engineering students in chennai
robotics course in chennai

Zinavo-Web Design | Web Development | SEO | Mobile Apps | ERP/CRM said...

Very nice blog, Thanks for sharing this informative blog..Keep posting Web Development Company in Bangalore | Web Designing Company in Bangalore

Zinavo Technologies Blog : Website Designing Company in Bangalore | Web Designing Companies in Bangalore

Admin said...

I just stumbled over this page and have to say - wow. The site is really good and kept up to date. Continue like
BCOM 1st Year TimeTable 2020
BCOM 2nd Year TimeTable 2020
BCOM 3rd Year TimeTable 2020

TIC Academy said...






Informative and nice blog post. Thanks for this wonderful Post.
SAP Training in Chennai
AWS Training in Chennai
Hardware and Networking Training in Chennai
QTP Training in Chennai
CCNA Training in Chennai

Vishali said...

Excellant post!!!. The strategy you have posted on this technology helped me to get into the next level and had lot of information in it.

Artificial Intelligence Training
Java Training
AWS Training
Machine Learning Training
Data Science Training
DevOps Training

Unknown said...

timber flooring in hopper crossing
Timber Flooring in Hopper Crossing, Melbourne is made wood. Forest has long been a popular choice among homeowners because of its inherent charm, look, and durability. Today, the timber floors Company are available in a lot more range and variety and have become more affordable than they were before

Admin said...

Here is the site(bcomexamresult.in) where you get all Bcom Exam Results. This site helps to clear your all query.
Sri Dev Suman University B.COM HONOURS 1st Sem Exam Result 2019-2022
BA 3rd year Result 2019-20
Sdsuv University B.COM 3rd/HONOURS Sem Exam Result 2018-2021

Unknown said...

Do you need an urgent loan of any kind? Loans to liquidate debts or need to loan to improve your business have you been rejected by any other banks and financial institutions? Do you need a loan or a mortgage? This is the place to look, we are here to solve all your financial problems. We borrow money for the public. Need financial help with a bad credit in need of money. To pay for a commercial investment at a reasonable rate of 3%, let me use this method to inform you that we are providing reliable and helpful assistance and we will be ready to lend you. Contact us today by email: daveloganloanfirm@gmail.com Call/Text: +1(501)800-0690 And whatsapp: +1 (315) 640-3560

NEED A LOAN?
Ask Me.

Parul Pathak said...

This site helps to clear your all query. ba exam time table
bsc 3rd year time table This is really worth reading. nice informative article.

Unknown said...

Do you need an urgent loan of any kind? Loans to liquidate debts or need to loan to improve your business have you been rejected by any other banks and financial institutions? Do you need a loan or a mortgage? This is the place to look, we are here to solve all your financial problems. We borrow money for the public. Need financial help with a bad credit in need of money. To pay for a commercial investment at a reasonable rate of 3%, let me use this method to inform you that we are providing reliable and helpful assistance and we will be ready to lend you. Contact us today by email: daveloganloanfirm@gmail.com Call/Text: +1(501)800-0690 And whatsapp: +1 (501) 214‑1395

NEED A LOAN?
Ask Me.

Rohini Sharma said...

I am really really impressed with your writing skills as well as with the layout on your blog.

BCom 3rd year time table

Agustin Svennigsen said...

You have lots of great content that is helpful to gain more knowledge. Best wishes.

meenakshi day pannel chart | meenakshi night pannel chart | dhan bazar day pannel chart | dhan bazar night pannel chart.