Attrasoft VideoFinderLite For Windows

Download Demo and DirectX!

Software Requirements

Installing the Software

• Unzip the file in folder c:\imagefinderlite\.
• Install DirectX (You may or may not already have DirectX).

Restrictions:

• *.wmv files;
• limited *.avi files;
• limited *.mpg files;
• 32 bit computing; and
• No parameter changes.

Information and Support

Statement of Copyright Restriction

• Each back-up copy must be treated in the same way as the original copy purchased from Attrasoft;
• No copy (original, or back-up) may be used while another copy, (original, or back-up) is in use;
• If you ever sell or give away the original copy of the program, all back-up copies must also be sold or given to the same person, or destroyed.

1. Introduction. 5

1.1 What is VideoFinderLite ?. 5

1.2 Fingerprint Concepts. 6

1.3 User Interface. 6

1.4 Supported Video Formats. 7

2. How to Use VideoFinderLite. 9

2.2 Example. 12

2.3 Beginner Tool Bar 13

3. Advanced Users. 14

3.1 Library Manual 14

3.2 Match Menu. 15

4. Examples. 17

4.1 News Search. 17

4.2 Commercial Ads Statistics. 18

5. Performance. 21

1. Introduction

1.1 What is VideoFinderLite ?

Attrasoft VideoFinderLite matches a newly obtained video clip against a pre-established library of video clips. VideoFinderLite searches 100,000 video clips per second or 100,000 hours of videos clips per second, after key fingerprinting (Figure 1.1).

Figure 1.1 Attrasoft VideoFinderLite.

Figure 1.2 The �Search� Menu and its menu items.

One application is to verify the copyright of a newly obtained video clip by matching it against a pre-established library of video clips. Another application is to collect statistics on TV advertisements after they are saved to a *.wmv file. We will provide two examples in chapter 4.

To operate the software, you will learn six steps; all of them can be found in the �Search� menu (Figure 1.2). This User�s Guide uses three examples to demonstrate the basic operations.

1.2 Fingerprint Concepts

The unique attributes of a video clip � its �video fingerprint� - are used. The matching between a new video clip and previously stored video clips is implemented via �Fingerprint� matching, i.e. all videos must be converted into �fingerprints� first. A library is a collection of previously stored fingerprints. The matching is done via a new key fingerprint against a particular library.

You can have as many libraries as you want. Before matching, you will need to select a library and load it to the Attrasoft VideoFinderLite; then, you are ready to search.

1.3 User Interface

The VideoFinderLite has three video panels: �Key�, �Library�, and �Results�.

Figure 1.3 Three sections: �Key�, �Library�, and �Results�. The Key video panel is labeled by the �Key� label.

Key:

A key is a newly captured/obtained video clip. Key videos are placed into a folder, which will be selected via the �Key� button. Use the �Play� and the �Stop� buttons next to the label �Key� to play a video clip.

Use the �Home�, �=>�, and �<=� button to select a video clip in the folder. The �Home� selects the first video in the folder; �=>� selects the next video in the folder; and �<=� selects the previous video.

Library:�

A library is a collection of fingerprints of videos. Library videos are selected via the �Library� button. Use the �Play� and the �Stop� button below the label �Library� to play a video clip.

Use the �Home�, �=>�, and �<=� button to select a video clip in the folder. The �Home� selects the first video in the folder; �>� selects the next video in the folder; and �<=� selects the previous video.

Results:

Use the �Play� and the �Stop� button below the label �Results� to play this video clip. Use the �Home�, �=>�, and �<=� button to select a video clip in the matched collections.

Figure 1.4 Three Video Panels: �Key�, �Library�, and �Results�. The Library video panel is labeled by the �Library� label.

1.4 Supported Video Formats

The Software Requirements are:

(1)   Microsoft Windows;

(2)   Microsoft DirectX;

(3)   Windows .Net Framework.

The VideoFinderLite uses Windows .Net Framework for video decoding and camera. It supports:

*.avi files;

*.wmv files; and

limited *.mpg files.

Other limits are:

����������� 32 bit computing;

����������� No parameters changes.

2. How to Use VideoFinderLite

Figure 2.1 Step 1, Select Library (Source button).

Initially, the operation will consist of the following six steps for video matching:

����������� 1. Select Library ("1..." button)

����������� 2. Get Library fingerprints ("2..." button)

����������� 3. Load Library ("3..." button)

����������� 4. Select Key ("4..." button)

����������� 5. Create Key fingerprint ("5..." button)

����������� 6. 1:N Matching ("6..." button)

Later, you do not have to create a library each time:

����������� 3. Load Library ("3..." button)

����������� 4. Select Key ("4..." button)

����������� 5. Create Key fingerprint ("5..." button)

����������� 6. 1:N Matching ("6..." button)

����������� �

The procedure is:

1. Select Library ("1..." button)

A video clip is converted into a video clip fingerprint. A set of video clip fingerprints forms a library. A set of video clips will be placed in a directory, and the directory path will be entered into the VideoFinderLite, for example, �c:\abc\def\�.

This step selects a video clip directory. Dragging & dropping a folder into the second text box will complete this step. This step can also be implemented by clicking:

o   �Search/1. Select A Folder� menu item, OR

o   "1. Folder" button.

The video clips in the selected directory will be displayed in the second picture box (labeled �Lib(rary)�). Use the �Play� buttons to play the video clip. Make sure to use �Stop� to stop the video clip.

Use the �Home� button to select the First video in the directory; use the �=>� button to select the next video clip; and use the �<=� button to select the previous video clip.

2. Create Fingerprint Library ("2..." button)

This step converts all video clips in the selected directory into fingerprints and saves them to the file, �a1.txt�. This step is implemented by clicking:

o   �Search/2. Create Fingerprint Library (.\a1.txt)� menu item, OR

o   �2. Library� button.

Figure 2.2 Step 3, Select Key (Key button).

3. Load Library ("3..." button)

Before matching, you will need to select a library and load it to the VideoFinderLite. This step is implemented by clicking:

o   �Search/3. Load Fingerprint Library� menu item, OR

o   �3. Load� menu item.

4. Select Key ("4..." button)

A key is a newly obtained video clip. The video clip is converted into a fingerprint. To select a key, drag & drop a folder into the first text box and select a file in this key folder. This step can also be implemented by clicking:

o   �Search/4. Select Key� menu item, OR

o   �4. Key� button.

����������� The video clips in the selected directory will be displayed in the first picture box (labeled �Key�).

����������� Use the �Play� buttons to play the video clip. Make sure to use �Stop� to stop the video clip.

Use the �Home� button to select the First video in the directory; use the �=>� button to select the next video clip; and use the �<=� button to select the previous video clip.

�

5. Create Key fingerprint ("5..." button)

����������� This step converts a key video clip into a fingerprint. This step is implemented by clicking:

o   �Search/5. Key Fingerprinting� menu item, OR

o   �5. Finprt� button.

Figure 2.3 Step 6, 1:N Matching.

6. 1:N Matching ("6..." button)

�1:N Matching� (read as 1 to N matching) compares �1� (i.e., the new video clip) with �N�

����������� (i.e., the previously stored video clips).� This step is implemented by clicking:

o   �Search/6. Search� menu item, OR

o   �Search� button.

����������� The 1:N matching results are also displayed in the third picture box (labeled �Results�).

����������� Use the �Play� buttons to play the video clip. Make sure to use �Stop� to stop the video clip.

Use the �Home� button to select the First video in the directory; use the �=>� button to select the next video clip; and use the �<=� button to select the previous video clip.

2.2 Example

In this section, we will use the �Friends� Video Clips. The stored data used in this section is in folder,

.\ test0 \

where �.\� is the folder where the software is installed. There are five video clips in this folder. The 1:N match compares a newly captured fingerprint with all video fingerprints in a1.txt.

�����������

1. Select Library ("1..." button)

Drag & drop �.\test0\� folder into the second text box.

2. Get Library fingerprints ("2..." button)

Click the �2 �� button; the results will be saved to �.\data\ a1.txt� automatically.

3. Load Library ("3..." button)

Click the �3 �� button to load the library.

4. Select Key ("4..." button)

Drag & drop �.\test0\� folder into the first text box. By default, the first file in this folder is chosen; you can select any file in this folder as a search key.

5. Create Key fingerprint ("5..." button)

Click the �5 �� button; the key fingerprint will be saved internally. You can also save the results by clicking Match/Key Fingerprinting (key.txt); followed by clicking �Match/1:N Matching (Key.txt : Library)� in step 6.

6. 1:N Matching ("6..." button)

Click the �6 �� button to make 1:N match, See Figure 2.4.

Figure 2.4 Step 6, 1:N Matching Text File Output.

2.3 Beginner Tool Bar

The beginner toolbar duplicates the Beginner menu.

Figure 2.5 The Beginner Tool Bar.

3. Advanced Users

3.1 Library Manual

Figure 3. Library Menu.

Before matching, you will need to select a library and load it to the Attrasoft VideoFinderLite. The library to be loaded can be a single file, or several files in a folder.

The single file library to be loaded is fixed to the file:

����������� �a1.txt�,

����������� �a2.txt�

The multiple file library to be loaded is fixed to the folder:

����������� .\data\lib1\*.txt

����������� .\data\lib2\*.txt

where ".\" is the folder where the VideoFinderLite is located. You can have as many libraries as you want.

You will need to manually place files into these folders. You will need to manage the video fingerprint library files yourself via Windows Explorer.

Create Initial Library (.\a1.txt)

����������� Use this menu item to create fingerprint library, a1.txt.

Create Additional Library (.\a2.txt)

����������� Use this menu item to create fingerprint library, a2.txt.

Load Initial Library (.\a1.txt)

����������� Use this menu item to load the library file, �a1.txt�.

Load Additional Library (.\a2.txt)

����������� Use this menu item to load the library file, �a2.txt�, on top of "a1.txt".

Load Libraries (.\data\lib1\*.txt)

����������� Use this menu item to load all library files in ".\data\lib1\".

Load Additional Libraries (.\data\lib2\*.txt)

����������� Use this menu item to load all library files in ".\data\lib2\", on top of existing loaded libraries.

3.2 Match Menu

Figure 3.2 Match Menu.

Match Menu makes 1:1, 1:N, and M:N matching.

Match/1:1 Matching (Current Key vs. Current Lib)

Use this menu item to make a �1:1 Matching�, the current video in the Key folder vs. the current video in the Library folder. This command will (1) compute the fingerprint of the key video, (2) the fingerprint of the selected video in the library folder, and (3) make a 1:1 match between the two fingerprints.

Match/1:N Matching (Key vs. Loaded Library)

Use this menu item to make a �1:N Matching� (read as 1 to N matching). �1:N Matching� compares �1� (i.e., the current video clip in Key folder) with �N� (i.e., the loaded library of video clips).�

����������� This menu item requires:

����������� (1) Fingerprint Library(s) is already loaded;

����������� (2) Newly captured video is already converted into a fingerprint.

Match/M:N Matching (a2.txt vs. Loaded Library)

Use this menu item to make a �M:N Matching� (read as M to N matching). �M:N Matching� compares �M� (i.e., all of the video clips in a2.txt) with �N� (i.e., the loaded library of video clips).

����������� This menu item requires:

����������� (1) Fingerprint Library(s) is already loaded;

(2) Newly captured video is already converted into a fingerprint library a2.txt via menu item, "Library/Create Additional Library (.\a2.txt)".

Match/Key Fingerprinting (key.txt)

Use this menu item to convert a key video clip into a fingerprint and save it to "key.txt". ����� This will avoid computing the same key fingerprint over and over again.

Match/1:N Matching (Key.txt : Library)

Use this menu item to make a �1:N Matching� (read as 1 to N matching). �1:N Matching� compares the saved key fingerprint ("key.txt") with �N� (i.e., the loaded library of video clips).

4. Examples

4.1 News Search

In this example, we take one hour of video, CNN-CNN-2006-12-25-9AM.wmv, which is CNN broadcasted on 2006-12-25 at 9 AM, and break it into 60 pieces. The length of each video is around 1 minute, but allows small variations. The start times are around each minute, but allows for a small variations.

The basic steps are:

�         Collect Video Data;

�         Make M:N Match;

�         Collect Results.

Collecting Video Data

The data folder is �.\test2\�. If a video starts around 1 minute, it is labeled as 001.wmv. There are 61 videos; the original one hour video and 60 one minute video clips.

Make an M:N Match

The M:N match compares all video fingerprints in �a2.txt� with �a1.txt�.

The operation is:

1. Select Library ("1..." button)

Drag & drop �.\test1\� folder into the second text box.

2. Get Library fingerprints ("2..." button)

Click the �2 �� button; the results will be saved to �.\data\ a1.txt� automatically.

3. Load Library ("3..." button)

Click the �3 �� button to load the library.

4. Select Key

The key for M:N match is a folder, �.\test1\�. We do not need to do anything here.

5. Create Key fingerprint (a2.txt)

Right click the �Start� button in your Windows and select Explore to start Windows Explorer. Use the Windows Explorer to save �.\data\a1.txt� to �.\data\a2.txt�.

6. M:N Matching

Make an N:M matching by clicking �Match\N:M Matching ��.

Collect the Results

The results are:

000.wmv

ID���������� Name���� ��������������� Path������� Length�� ��������������� Score����� Start������ Length

000�������� 000.wmv�������������� .\test1\��� 60.16����� ��������������� 100�������� 0������������� 60

CNN-CNN-2006-12-25-9AM���������� CNN-CNN-2006-12-25-9AM.wmv

.\test1\��� 3598.047�������������� 60���������� 0������������� 60

001.wmv

ID���������� Name���� ��������������� Path������� Length�� ��������������� Score����� Start������ Length

001�������� 001.wmv�������������� .\test1\��� 60.048�� ��������������� 100�������� 0������������� 60

CNN-CNN-2006-12-25-9AM���������� CNN-CNN-2006-12-25-9AM.wmv

.\test1\��� 3598.047�������������� 45���������� 44���������� 60

�

The folder consists of 61 files:

CNN-CNN-2006-12-25-9AM.wmv

000.wmv

001.wmv

002.wmv

�

In the first result, the input video is 000.wmv. It has two matches:

CNN-CNN-2006-12-25-9AM.wmv

000.wmv

The first match is 000.wmv. The match score is 100; the start matching position is 0 second and length of the matching is 60 seconds. The second match is CNN-CNN-2006-12-25-9AM.wmv, with a score of 60; the start matching position of 0 second and length of 60 seconds.

In the second result, the input video is 001.wmv. It has two matches:

CNN-CNN-2006-12-25-9AM.wmv

001.wmv

The first match is 001.wmv. The match score is 100; the start matching position is 0 second and length of the matching is 60 seconds. The second match is CNN-CNN-2006-12-25-9AM.wmv, with score of 45; the start matching position of 44 seconds and length of 60 seconds.

4.2 Commercial Ads Statistics

In this next example, we show how to collect ad statistics using the VideoFinderLite. The original video is one hour long, CNNE-NAM-2007-01-18-1PM.wmv, which is CNN NAM channel on 2007-01-18, 1PM. The basic steps are:

�         Collect video ads;

�         Collect video data;

�         Make M:N Match;

�         Collect Results.

Collecting Ads

The data is stored in folder, �.\test2\�. It contains one hour of live TV video on the CNN NAM �channel, 2007-01-18, 1PM in WMV format. A viewer will go through the video and manually cut the ads out; it contains 5 video ads in the following Ads Table:

ID������������������� Name�� ����������� ����������� Video length (second)

0001��������������� Bosley������������ ����������� 59

0002��������������� People PC������� ����������� 59

0003��������������� Consulta Media������� 12

0004��������������� Aldia��������������������������� 29

0005��������������� Woman Ad����������������� 43

Collecting Video data

We will make this as simple as possible; we will put the original video and all five ads in the folder �.\test2\� and fingerprint the six videos.

Make an M:N Match

The M:N match compares all video fingerprints in �a2.txt� with �a1.txt�. The operation is:

1. Select Library ("1..." button)

Drag & drop �.\test2\� folder into the second text box.

2. Get Library fingerprints ("2..." button)

Click the �2 �� button; the results will be saved to �.\data\ a1.txt� automatically.

3. Load Library ("3..." button)

Click the �3 �� button to load the library.

4. Select Key

The key for M:N match is a folder, �.\test2\�. We do not need to do anything here.

5. Create Key fingerprint (a2.txt)

Right click the �Start� button in your Windows and select Explore to start Windows Explorer. Use the Windows Explorer to save �.\data\a1.txt� to �.\data\a2.txt�.

6. M:N Matching

Make an N:M matching by clicking �Match\N:M Matching ��.

Collect the Results

In this hour of TV program (CNN NAM channel, 2007-01-18, 1PM), the ads are:

Ads����������������� ����������� Start (second)�������������� Length (second)

Bosley������������ ����������� 662����������������������������� 59

����������������������� ����������� 1505��������������������������� 59

People PC������� ����������� 722����������������������������� 59

����������������������������������� 1194��������������������������� 59

����������������������������������� 1565��������������������������� 59

����������������������������������� 2217��������������������������� 59

����������������������������������� 2425��������������������������� 59

����������������������������������� 2809��������������������������� 59

Consulta Media�������������� 1260��������������������������� 12

Aldia��������������������������� 3318��������������������������� 29

Woman�s Ad�������������� 3554��������������������������� 43

The first ad is Bosley, which starts at 662 seconds or 11 minutes; it lasts 59 seconds or about 1 minute.

�����������

5. Performance

The software performance parameters are:

Fingerprinting speed: every 3 hours of video takes 1 hour to fingerprint.

Fingerprint size: every hour of video takes 200 KB.

Search speed: 100,000 video clips per second or 100,000 hours of video after key fingerprinting is completed.

Accuracy: if the unknown video is in the library, the rate is 100% with a matching score 100. A matching score of 80 or above will have 100% accuracy.

Video Distortion: The Lite version allows for small distortion by saving one video format into another format.

Video Codec Variation: Different video codecs are allowed.

�

Shortest length: This version limit is 15 seconds, although a customized VideoFinder can find a single frame in 1/30 of a second.

Customization: The VideoFinderLite has three internal filters: Unsupervised Filter, BioFilter, and NeuralFilter. The VideoFinderLite uses the Unsupervised Filter, which is the least accurate filter. For customization, contact gina@attrasoft.com.

Download Demo and DirectX!