Attrasoft
FlvFinder 1.0
For Windows
Attrasoft
FlvFinder
Attrasoft
P. O. Box 13051
Savannah, GA. 31406, USA
gina@attrasoft.com
(Email Subject: Attrasoft)
Phone: (912)
484-1717
© Attrasoft 1998 - 2008
Keywords: Video Retrieval, Video Matching,
Content-Based Recognition, Identification, Flv, Flash Video, YouTube, Mpeg
About Attrasoft FlvFinder™
Attrasoft FlvFinder™ matches a newly obtained video clip against a pre-established library of video clips.
FlvFinder™ supports *.flv format only; for other formats, please check Attrasoft VideoFinder™.
Who Needs FlvFinder™ ?
If you have 100, 1000, or more YouTube files (flv files), chances are sometimes you will want to match a newly downloaded video against your collection.
If matching by file names alone is not enough, FlvFinder™ is the tool you will need to match video contents.
Software Requirements
Software Requirements:
(1) Microsoft
Windows XP.
Installing the Software
1. Unzip the zip file to a folder.
2. Click .\flvfinder\flvfinder10.exe to run FlvFinder 1.0.
Statement of Copyright Restriction
Attrasoft has copyrighted the Attrasoft FlvFinder™.
FlvFinder 1.0 is a freeware for beta testing. Send your comments to gina@attrasoft.com.
Once the beta testing is over, FlvFinder™ will be merged into Attrasoft VideoFinder™ and FlvFinder™ will cease to exist.
© Attrasoft 2008
Table Of Contents
Statement of Copyright Restriction
1. Introduction To FlvFinder
Figure 1.1 Attrasoft FlvFinder
verifies the copyright information of a newly obtained video clip by matching
it against a pre-established library of video clips.
FlvFinder™ is Attrasoft's solution for video content owners. It enables a content owner such as a media company, production studio, or content distributor to fingerprint, detect, & measure their content as it appears on a variety of online sites.
The matching between a new video clip and previously stored video clips is implemented via “fingerprint” or “signature” matching, i.e. all videos must be converted into fingerprints/signature first.
FlvFinder™ enables fast & easy creation of a fingerprint library. The fingerprints in the library are then compared to fingerprints of videos pulled down from the web. Matches are presented side-by-side, along with their accuracy score, for verification and/ or further investigation. FlvFinder™ has the following advantages:
(1) Automatic Search -- Saving your precious labor hours.
(2) Error Reduction – Reducing errors caused by human memory & fatigue.
1.1 FlvFinder Functions
Attrasoft FlvFinder matches a newly obtained video clip against a pre-established library of video clips.
After installing the software, the folder structure is:
Flvfinder\
The FlvFinder software is stored in the “flvfinder\” folder; and the examples are stored in the “examples\” folder.
1.2 Beginner Menu
The FlvFinder has a “Beginner” menu. You can operate the software from the “Beginner” menu alone.
Figure 1.2 The “Beginner” Menu
and its menu items.
1.3 Fingerprint Concepts
The unique attributes of a video clip – its “video fingerprint” - are used. A fingerprint is a set of values unique to a particular video.
In this guide, we use fingerprints and signatures interchangeably. If you must insist, a signature consists of attributes of a video frame, and a fingerprint consists of attributes of an entire video.
The matching between a new video clip and previously stored video clips is implemented via “fingerprint” matching, i.e. all videos must be converted into fingerprints first. A library is a collection of previously stored fingerprints. The matching is done via a new key fingerprint against a particular library.
You can have as many libraries as you want. Before matching, you will need to select a library and load it to the Attrasoft FlvFinder; then, you are ready to verify the copyright information.
1.4 User Interface
The FlvFinder has three video panels: ‘Key’, ‘Library’, and ‘Results’.
Figure 1.3 Three Video Panels:
‘Key’, ‘Library’, and ‘Results’. The Key video panel is labeled by the ‘Key’
label.
Key:
A key is a newly captured/obtained video clip. A key video is selected via the “Key” button. Use the “Play” and “Stop” button below the label ‘Key’ to play this video clip.
Library:
A library is a collection of previously stored video clips. Library videos are selected via the “Library” button. Use the “Play” and the “Stop” button below the label ‘Library’ to play a video clip. Use the “F”, “>”, and “<” button to select a video clip in the library, here “F” stands for First; “>” stands for Next; and “<” stands for previous.
Results:
Use the “Play” and the “Stop” button below the label ‘Results’ to play this video clip. Use the “F”, “>”, and “<” button to select a video clip in the matched collections.
Figure 1.4 Three Video Panels:
‘Key’, ‘Library’, and ‘Results’. The Library video panel is labeled by the
‘Library’ label.
1.5 Supported Video Formats
The FlvFinder supports *.flv files only. For other format, order Attrasoft VideoFinder.
1.6 Key Differentiators
Key Differentiators are:
- High Accuracy Rates: Can be customized to get > 99.9% accuracy.
- Real Time: Can reach 100,000 to 1,000,000 frame-to-frame matches per second depending upon the processor speed. Customized versions are faster.
- Scalability: can be scaled to any size database via customization.
- Customized Solutions Available!
1.7 Customizations
Customized FlvFinder™ applications are limited only by your imagination.
Video Ad Recognition
Video Image Recognition
Real Time Event Detection
Object Detection
Internet Audio-Visual Search Engine
Content Based Image Retrieval (Video Digital Library)
Counting & Tracking
Customized versions can accommodate:
High Accuracy Rates
Speed Optimization
Multi-Layered Image Matching
New Image Preprocessing Filters
Specific Symmetries
Video File Formats
Programming Library
Friendly User Interface
Database Interface (combine FlvFinder with Database)
Your Specific Project Requirements
….
1.8 Potential Application
Uses for FlvFinder™ solution are:
Anti-Piracy
Media Measurement
Content Monetization
Content Tracking
Content License Rights Verification
Potential users include:
Advertising Agencies
Movie Production Studios
Media Companies
Content Distribution Websites
Social Networking Websites
…
1.9 Other Related products
VideoFinder™ is an Off-the-Shelf Application Software to quickly test users own Video Recognition ideas.
ImageFinder™ is an Off-the-Shelf Application Software to quickly test users own Image Recognition ideas.
TransApplet™ is a developer tool (.Net Class Library) that
enables users to quickly add Image Recognition capability to their products
& services.
ImageHunt™ matches images from a web site.
2. How to Use FlvFinder
Initially, you will need the following steps for video matching:
0. Initialization (Only Once after starting the software)
1. Select Library (Source button)
2. Get Library Signatures (source.txt)
3. Select Key (Key button)
4. Get Key Signatures (key.txt)
5. Create Library File (lib1.txt)
6. Load Library (lib1.txt)
7. 1:N Matching (Match/1:N Match menu item)
8. First Results (2nd F button)
9. Next Results (2nd > button)
Later, you do not have to create a library each time:
0. Initialization (Only Once After Starting the Software)
6. Load Library (lib1.txt)
3. Select Key (Key button)
4. Get Key Signatures (key.txt)
7. 1:N Matching (Match/1:N Match menu item)
3. Select Key (Key button)
4. Get Key Signatures (key.txt)
7. 1:N Matching (Match/1:N Match menu item)
…
2.1 How to Use FlvFinder
0. Initialization (Only Once
After Starting the Software)
This step initializes the software. This step is implemented by clicking:
· “Beginner/0. Initialization (Only Once)” menu item, OR
· “Init” button.
This step will take one minute.
1. Select
Library (Source button)
A video clip is converted into a video clip signature. A set of video clip signatures forms a library. A set of video clips will be placed in a directory and the directory path (for example, “c:\abc\def\”) will be entered into the FlvFinder.
This step selects a video clip directory by clicking any file in the folder. This step is implemented by clicking:
· “Beginner/1. Select Library (Source button)” menu item, OR
· “Source” button.
The video clips in the selected directory will be displayed in the second picture box (labeled ‘Library’).
Use the “Play” and “Stop” buttons to play the video clip;
Use the “F” button to select the First video in the directory;
Use the “>” button to select the next video clip; and
Use the “<” button to select the previous video clip.
Figure 2.1 Step 1, Select
Library (Source button)
2. Get Library Signatures (source.txt)
This step converts all video clips in the selected directory into signatures and saves them to the file, “source.txt”. This step is implemented by clicking:
· “Beginner/2. Get Library Signatures (source.txt)” menu item, OR
· “Signature/Library Signatures” menu item.
3. Select Key (Key button)
A key is a newly obtained video clip. The video clip is converted into a signature. The key (for example, “c:\abc\def\ghi.flv”) will be entered into the FlvFinder.
This step selects a key. This step is implemented by clicking:
· “Beginner/3. Select Key (Key button)” menu item, OR
· “Key” button.
The selected key will be displayed in the first picture box. Use the “Play” and “Stop” buttons to play the video clip.
Figure 2.2 Step 3, Select Key
(Key button)
4. Get Key Signatures
(key.txt)
This step converts a key video clip into a signature and saves them to the file, “key.txt”. This step is implemented by clicking:
· “Beginner/4. Get Key Signatures (key.txt)” menu item, OR
· “Signature/Key Signature” menu item.
5. Create Library File
(lib1.txt)
Before matching, you will need to select a library and load it to the FlvFinder. The library to be loaded is fixed to the file, “lib1.txt”. We have created a library file, “source.txt”; now we will simply copy it to the loading-library file, “lib1.txt”.
This step is implemented by clicking:
· “Beginner/5. Create Library File (lib1.txt)” menu item, OR
· “Library/Copy source.txt to lib1.txt” menu item.
6. Load Library (lib1.txt)
Before matching, you will need to select a library and load it to the FlvFinder. This step is implemented by clicking:
· “Beginner/6. Load Library (lib1.txt)” menu item, OR
· “Library/Load (lib1.txt)” menu item.
7. 1:N Matching (Match/1:N Match menu item)
“1:N Matching” (read as 1 to N matching) compares “1” (i.e., the new video clip) with “N” (i.e., the previously stored video clips). This step is implemented by clicking:
· “Beginner/7. 1:N Matching” menu item, OR
· “Match/1:N Matching” menu item.
Figure 2.3 Step 7, 1:N
Matching.
Figure 2.4 Step 7, 1:N
Matching Text File Output.
8. First Results (2nd
“F” Button)
The 1:N matching results are also displayed in the third picture box (labeled ‘Results’).
To select the first retrieved video clip, use:
· “Beginner/8. First Results (2nd “F” Button)” menu item, OR
· Second “F” button.
Use the “Play” and “Stop” buttons to play the video clip.
9. Next Results (2nd
> Button)
The 1:N matching results are also displayed in the third picture box (labeled ‘Results’).
To select the next retrieved video clip, use:
· “Beginner/9. Next Results (2nd > Button)” menu item, OR
· Second “>” button.
Use the “Play” and “Stop” buttons to play the video clip.
2.2 Example
In this section, we will use Video Clips in the FlvFinder. After installing the software, the folder structure is:
.\FlvFinder\
.\Examples\
.\Examples\lib\
.\Examples\unknown\
where “.\” is the folder where the software is installed. The data stored used in this section is in folder, “.\examples\lib\”.
0. Initialization (Only Once
After Starting the Software)
After starting the software, click:
· “Beginner/0. Initialization (Only Once)” menu item, OR
· “Init” button.
This step will take one minute.
1. Select Library (Source
button)
Click:
· “Beginner/1. Select Library (Source button)” menu item, OR
· “Source” button.
Go to folder, “.\examples\lib\”, and select any file, see Figure 2.1. The video clips in the selected directory will be displayed in the second picture box (labeled ‘Library’).
Use the “Play” and “Stop” buttons to play the video clip.
Use the “F” button to select the First video in the directory; use the “>” button to select the next video clip; and use the “<” button to select the previous video clip.
2. Get Library Signatures (source.txt)
This step converts all video clips in the selected directory into signatures and saves them to the file, “source.txt”. This step is implemented by clicking:
· “Beginner/2. Get Library Signatures (source.txt)” menu item, OR
· “Signature/Library Signatures” menu item.
3. Select Key (Key button)
Click:
· “Beginner/3. Select Key (Key button)” menu item, OR
· “Key” button.
And select “.\examples\unknown\unknown_0001.flv”, see Figure 2.3. The selected key will be displayed in the first picture box. Use the “Play” and “Stop” buttons to play the video clip.
4. Get Key Signatures
(key.txt)
Click:
· “Beginner/4. Get Key Signatures (key.txt)” menu item, OR
· “Signature/Key Signature” menu item.
5. Create Library File
(lib1.txt)
Click:
· “Beginner/5. Create Library File (lib1.txt)” menu item, OR
· “Library/Copy source.txt to lib1.txt” menu item.
6. Load Library (lib1.txt)
Click:
· “Beginner/6. Load Library (lib1.txt)” menu item, OR
· “Library/Load (lib1.txt)” menu item.
7. 1:N Matching (Match/1:N Match menu item)
Click (Figure 2.3 and 2.4):
· “Beginner/7. 1:N Matching” menu item, OR
· “Match/1:N Matching” menu item.
8. First Results (2nd
F Button)
Click:
· “Beginner/8. First Results (2nd “F” Button)” menu item, OR
· Second “F” button.
Use the “Play” and “Stop” buttons to play the video clip.
9. Next Results (2nd
> Button)
Click:
· “Beginner/9. Next Results (2nd > Button)” menu item, OR
· Second “>” button.
Use the “Play” and “Stop” buttons to play the video clip.
2.3 Beginner Tool Bar
Figure 2.5 The Beginner Tool Bar.
The beginner toolbar duplicates the Beginner menu.
3. Advanced Users
3.1 Signatures
Figure 3.1 Signature Menu.
The matching between a new video clip and previously stored video clips is implemented via “Signature” matching, i.e. all videos must be converted into signatures first. A library is a collection of previously stored signatures. The matching is done via a new key signature against a particular library. You can have as many libraries as you want.
Before matching, you will need to select a library and load it to the FlvFinder; then, you are ready to verify the copyright information. The Signature menu provides you the menu items required for converting a video into signature files.
3.1.1 Library Signatures
The default library signatures are computed at the rate of 1 signature every 1.0 second. The menu items are:
Signature/Library Signature
Use "Signature/Library Signature" menu item to collect signatures from a source specified by the "Library" button and displayed in the ‘Library’ text box.
Signature/Get Current Source Signature
Use "Signature/Get Current Source Signature" menu item to collect signatures from a single video currently selected via the "F"-button, ">"-button, or "<"-button and save it to file, “source_current.txt”.
This rate of 1 signature per second can be reset via the “Parameter” button, which will specify the starting frame, ending frame, and interval between signatures. The following menu item will compute the signatures with the user-specified starting frame, ending frame, and interval between signatures.
Signature/Library Signature (User Setting)
Use the "Signature/Library Signature" menu item to collect signatures from a source specified by the "Library" button and displayed in the ‘Library’ text box. Users via the “Parameter” button determine the start frame, ending frame, and interval.
Example:
Let a video clip be 60 seconds, the default setting will be:
Starting Frame = 0
Ending Frame = 60
Interval = 1
You set it to:
Starting Frame = 10
Ending Frame = 30
Interval = 2
Now you collect 10 frames.
3.1.2 Key Signatures
The default key signatures are computing 40 – 80 signatures, depending on the length of the video. The menu item is:
Signature/Key Signature (Default)
Use "Signature/Key Signature (Default)" to convert a key video clip into a signature and save them to the file, “key.txt”.
The Key Signature Rules are:
Let N be the video Length In Seconds,
If N < 40 seconds, then the number of signatures is N, one per second;
Else if N < 80 seconds, then the number of signatures is 40, one per second;
Else if N < 120 seconds, then the number of signatures is 40, one every 2 seconds;
Else if N < 160 seconds, then the number of signatures is 40, one every 3 seconds;
Else if N < 200 seconds, then the number of signatures is 40, one every 4 seconds;
Else if N < 240 seconds, then the number of signatures is 40, one every 5 seconds;
Else if N < 280 seconds, then the number of signatures is 40, one every 6 seconds;
Else if N < 320 seconds, then the number of signatures is 40, one every 7 seconds;
Else if N < 360 seconds, then the number of signatures is 40, one every 8 seconds;
Else if N < 400 seconds, then the number of signatures is 40, one every 9 seconds;
Else if N < 440 seconds, then the number of signatures is 40, one every 10 seconds;
Else if N < 500 seconds, then the number of signatures is 40, one every 10 seconds;
Else if N < 550 seconds, then the number of signatures is 50, one every 10 seconds;
Else if N < 600 seconds, then the number of signatures is 50, one every 11 seconds;
Else if N < 650 seconds, then the number of signatures is 50, one every 12 seconds;
…
Besides the default setting, there are several options:
Signature/Key Signature (20)
Use "Signature/Key Signature (20)" menu item to collect 20 signatures from a video, regardless of the video length.
Signature/Key Signature (40)
Use "Signature/Key Signature (40)" menu item to collect 40 signatures from a video, regardless of the video length.
Signature/Key Signature (80)
Use "Signature/Key Signature (80)" menu item to collect 80 signatures from a video, regardless of the video length.
Signature/Key Signature (Every 2 Sec)
Use "Signature/Key Signature (Every 2 Sec)" to convert a key video clip into a signature and save them to the file, “key.txt”. The number of signatures is the video length in seconds divided by 2.
Again, the “Parameter” button will specify the starting frame, ending frame, and interval between signatures. The following menu item will compute the signatures with the user-specified starting frame, ending frame, and interval between signatures.
Signature/Key Signature (User Setting)
Use "Signature/Key Signature (User Setting)" to convert a key video clip into a signature and save them to the file, “key.txt”. Users, via the “Parameter” button, determine the start frame, ending frame, and interval.
3.2 Detailed Matching Results
You can get detailed information on “which frame in the key has matched with which frame of a video in a library”.
Please note that the frame
with the same ID in the key will not necessarily mean the same frame in the
library, because the default library signatures are computed at the rate of 1
signature every 1.0 second, while the key signatures are not computed at the
rate of 1 signature every 1.0 second.
To see the detailed matching, go to the Text tab. (See Figure 3.2)
Figure 3.2 Detailed Matching.
In this example,
FRIENDS_SEASON_2_0001_000001
Matched with the following frame:
FRIENDS_SEASON_2_0001_000001 760057
3.3 Libraries
You can have as many libraries as you want. Before matching, you will need to select a library and load it to the FlvFinder.
The library to be loaded can be a single file, or several files in a folder.
As we have seen earlier, the easiest way to load library initially is to use file, “.\data\lib1.txt” and load it. This step is implemented by clicking:
- “Beginner/6. Load Library (lib1.txt)” menu item, OR
- “Library/Load (lib1.txt)” menu item.
As you have collected more video libraries, this method becomes inconvenient, so there are two additional methods for loading libraries, one for loading a single library and one for loading multiple libraries. This will be done in the Library Tab.
The folders used for the Library Tab are fixed:
.\data\library
.\data\libraries
where ".\" is the folder where the FlvFinder is located.
To select and load ONE library, go to the Library tab and use the “Open Single Library” and the “Load Library” buttons.
To select and load All libraries in a folder, “.\Release\data\libraries”, go to the Library tab and use the “Open Library List” and the “Load Library” buttons. The buttons are:
Open Single Library
Use the "Open Single Library" button to list all library files in ".\data\library".