Unifying Textual and Visual Cues for Content-Based Image Retrieval on the World Wide Web

Stan Sclaroff; Marco La Cascia; Saratendu Sethi; Leonid Taycher

doi:10.1006/cviu.1999.0765

Abstract

A system is proposed that combines textual and visual statistics in a single index vector for content-based search of a WWW image database. Textual statistics are captured in vector form using latent semantic indexing based on text in the containing HTML document. Visual statistics are captured in vector form using color and orientation histograms. By using an integrated approach, it becomes possible to take advantage of possible statistical couplings between the content of the document (latent semantic content) and the contents of images (visual statistics). The combined approach allows improved performance in conducting content-based search. Search performance experiments are reported for a database containing 350,000 images collected from the WWW.

Keywords

Computer scienceInformation retrievalContent (measure theory)Content-based image retrievalArtificial intelligenceImage (mathematics)Image retrievalComputer visionMathematics

Affiliated Institutions

Boston University US

Related Publications

Discovering objects and their location in images

Josef Šivic , Bryan Russell , Alexei A. Efros +2 more

We seek to discover the object categories depicted in a set of unlabelled images. We achieve this using a model developed in the statistical text literature: probabilistic Laten...

2005 980 citations

Learning Visual Semantic Relationships for Efficient Visual Retrieval

Richang Hong , Yang Yang , Meng Wang +1 more

In this paper, we investigate how to establish the relationship between semantic concepts based on the large-scale realworld click data from image commercial engine, which is a ...

2015 IEEE Transactions on Big Data 99 citations

Using Linear Algebra for Intelligent Information Retrieval

Michael W. Berry , Susan Dumais , Gavin O'Brien

Currently, most approaches to retrieving textual materials from scientific databases depend on a lexical match between words in users’ requests and those in or assigned to docum...

1995 SIAM Review 1482 citations

Discriminative tag learning on YouTube videos with latent sub-tags

Weilong Yang , George Toderici

We consider the problem of content-based automated tag learning. In particular, we address semantic variations (sub-tags) of the tag. Each video in the training set is assumed t...

2011 40 citations

Modeling scenes with local descriptors and latent aspects

Pedro Quelhas , Florent Monay , Jean‐Marc Odobez +3 more

We present a new approach to model visual scenes in image collections, based on local invariant features and probabilistic latent space models. Our formulation provides answers ...

2005 345 citations

Publication Info

Year: 1999
Type: article
Volume: 75
Issue: 1-2
Pages: 86-98
Citations: 130
Access: Closed

External Links

View on DOI.org

Social Impact

Altmetric

Unifying Textual and Visual Cues for Content-Based Image Retrieval on the World Wide Web

PlumX Metrics

Social media, news, blog, policy document mentions

Citation Metrics

130

OpenAlex

Cite This

APA Style

                            
                                
                                    Stan Sclaroff, 
                                
                                    Marco La Cascia, 
                                
                                    Saratendu Sethi
                                
                                et al.
                            
                            (1999). 
                            Unifying Textual and Visual Cues for Content-Based Image Retrieval on the World Wide Web. 
                            Computer Vision and Image Understanding
                            , 75
                            (1-2)
                            , 86-98.
                            https://doi.org/10.1006/cviu.1999.0765
                        

Identifiers

DOI: 10.1006/cviu.1999.0765