My Issues

Qimera

How-to Qimera - Working with QINSy Data

Working with QINSy Data

This How-to describes how to add and work with QINSy data in Qimera.

On this page:

For additional information, see our Getting Started article.

 

Data

The data used for this How-to is single head EM2040C data from Brest, France, that was acquired using QINSy and was provided by Université de Brest; these files are available for download  .

About QINSy Data

The supported Raw Sonar format for QINSy data DB; these files are logged by the QINSy acquisition software online. If QINSy QPD files are available, they will be used by Qimera; otherwise, Qimera will generate new QPD files when the DB files are added. QINSy QPD files can also be added as Processed Point files, and QINSy GRD grid files can be added using the Import Grid option in the Layer menu.

Howto Info

You can view a full-size version of any image in this How-to by clicking on the image. Numbers in images are referred to in the text preceding the image or in the image caption itself. Blue text indicates a link to the manual, another document, or data.

The import and processing of raw data formats is dependent on licensing. In Qimera, go to the Help drop-down menu and choose View License Status to view your current license coverage.

Qimera can use either logged DBs, template DBs, or QPDs to establish the project CRS (Coordinate Reference System). Here is the order that Qimera will use:

1) If a DB is present, it will be used to establish CRS. This is true when opening a project for either Point Cleaning OR Full Sonar Processing. This is also the case when a DB is brought into a new Qimera project.

2) If a QINSy project is opened and there is no logged DB present, the template DB (if present) will be used to set the CRS.

3) If there are no logged or template DBs present, the QPDs will set the CRS.

In all cases, the first valid source of a CRS definition will be used. If you have several CRSs defined across multiple DBs, tempates, or QPDs, care must be taken that the correct CRS is set. Once it is set, it cannot be changed for a project.

Launch Qimera


Launch Qimera by clicking on the icon, or from the applications menu of your computer (using Windows: Start > All Programs > QPS > Qimera).

Open Existing QINSy Project or Create a New Project


Existing Project or New Project?

In Qimera, you can choose to open an existing QINSy project, which will load the existing DB and QPD files (if the QPD files exist), or to create a New Project and add the DB files as source files. Both options are reviewed below.

QPDs can also be used to create a Qimera project if desired.

Option 1: Opening an Existing QINSy Project

  1. After you open Qimera, the Welcome Screen will launch. Select Open Other, then navigate to and select your QINSy project directory. 


    Qimera Welcome Screen, Open Other option.

  2. Navigate to and select your QINSy project.


    Selecting the QINSy project directory.

    Open Project

    Alternatively, you can open a project by clicking the Open Project Button or by going to the Project menu and choosing Open Project.



  3. If your project contains both QPDs and DB files, a prompt window will appear asking how you want to open your project:


  4. If you select 'Full Sonar Processing', Qimera will load the QINSy project, scanning for and extracting any available information as it opens the project (for a full list of what is extracted from each supported format, click here). As the project opens, DB files will be listed in the Project Sources under Raw Sonar Files and an indicator will show the progress of loading that individual file (1), loaded tracklines will visualize in the 4D Scene (2), and overall progress for data extraction (3) and any warnings or errors (4) will show in the Job Activity Window. Extracted information for QINSy projects can include:

    • QPD files, if available

    • vessel configuration

    • position

    • heading

    • motion

    • sound velocity

    • tide and/or GPS/GNSS height corrections


    Information being extracted from the QINSy project during load.
  5. If you select 'Point Cleaning', Qimera will only load the QPD files from the DtmData folder in the QINSy project directory. The QPDs will be listed in the Project Sources under Processed Point Files. The project can be 'upgraded' to full sonar processing by right clicking on a QPD and selecting 'Load Associated DB File'.

    Qimera will automatically create some new folders and files inside of the existing QINSy project. These additional folders and files are used to maintain metadata, hold extracted information, and provide locations for newly created files (click here for an overview of the Qimera Project Structure and what is stored in each

  6. Once the project data extraction is complete, you will see the extracted vessel and QPD information (if QPD files were generated in QINSy) in the File Table (1) and can review any encountered errors in the Job Activity Window (2). All of the DB files from the project will be in the Project Sources Window under Raw Sonar Files and extracted ancillary files will be listed under the appropriate Parents (3), and all of the tracklines will be visible in the 4D Scene (4). For this example dataset, the Job Activity window displays a warning that vessel system offsets are all zero and there is also a prompt at the top of the 4D Scene (5) with similar information; this is discussed in the Info box below. There is also a warning that Metadata Extraction failed for the file named ConfigBase_EM2040C_POSMV_TrueHeave.db, and that file is red in the Project Sources tree view (see highlighted text in the image). In this dataset, that file is the QINSy template database and does not contain any data, so this is not a cause for concern.


    Data extraction complete.


    Zero Vessel Offsets

    In this sample dataset, you see a warning that "Vessel system location offsets are all zero" as well as a prompt noting that "Your vessel offsets are all zero. Would you like to edit your vessel settings now?" Clicking Yes at the prompt to open the Vessel Editor (or select Tools > Edit Vessel from the Main Menu). A review of the settings in the Vessel Editor will show that the Starboard, Forward, and Up Transducer Offsets are all set to zero. This vessel was equipped with a POS MV, and all referencing was done to the POS rather then in QINSY. This is a typical warning for this set-up and is not a cause for concern, and no action is necessary.



    Vessel Offsets set to zero in the Vessel Editor.
  7. As information is extracted from the QINSy files, the additional folders that Qimera created in the project get populated with the information.


    Extracted information for line 0002_Wreck_*** in the Metadata folder.


    Extracted SVP information in the SVP folder.


  8. If there are any Dynamic Surfaces that were built by QINSy while Online or in Processing Manager, these will be detected by Qimera and loaded automatically.



    No QPDs or QPD1 files in Project

    When a project doesn't contain QPD files, the DB files in the Project Sources tree view will be followed by the symbol, indicating that they still require processing. Clicking the Auto Process or building a Static or Dynamic Surface will trigger the files to be processed and QPD files to be generated.


    DB files with indication that reprocessing is required.

    When a project containing older QPD files (QPD1) is loaded a popup warning will appear stating that QPDs require updating and that after upgrade the project won't be usable in older versions of QPS software (Fledermaus 7.4.5.b and QINSy 2015.06.29 or previous)

    Before the QPDs are finally upgraded, another popup warning will appear stating that old QPDs were found and that upgraded copies will be made inside the project folder:

    , Qimera will automatically regenerate the files in the upgraded QPD2 format and write the new files to the QINSy project. The process will be noted in the Job Activity.


    Message about QPD upgrade in Job Activity Window.

Option 2: Creating a New Project & Adding Raw Sonar Data

  1. After you open Qimera, the Welcome Screen will launch. Select New Project and Create (or simply double-click on New Project).


    Qimera Welcome Screen, New Project.

  2. Fill in Project Details:
    1. Add project name information (1).
    2. By default, the folder for your project will be in the '/Users/username/FMData/Projects' directory, though you can choose another location (2).
    3. The Description box can be used to add additional notes about the project (3).
    4. Set the Project Coordinate System (4).
      1. When working with QINSy data, the default setting of "Automatic" will choose the same coordinate system that is set in the QINSy files. It is good to note that this is not how this option works with other data types – for other formats, Automatic will choose the UTM zone that matches the coordinates of the first file Qimera scans.
      2.  You can select Manual and choose a different projection if you would like your Qimera products (QPDs, surfaces, etc.) to be in a projection that differs from your source DB files. The projection of the DB files will be read correctly, and any existing QPD files QImera finds will be ignored; products you create will be in the project projection.

  3. Click OK to create the project. Once created, the project folder will contain sub-folders for storing bathymetry files in QPD format, internal metadata, extracted external source data, and products.   


    Create Project Dialog.

    Create Project

    Alternatively, you can create a project by clicking the Create Project Button or by going to the Project menu and choosing New Project.



  4. You will be prompted to add source files to you new project. Choose Add Raw Sonar Files.


    Add Source Files prompt.

    Add Source Files

    Alternatively, you can add Raw Sonar Source Files by clicking the Add Raw Sonar File button or by going to the Source menu and choosing Add Raw Sonar Files.



  5. Use Add Files to navigate to and select the DB files from the Database folder of your QINSy project. Click OK to load the files.


    Add Files Wizard

    Coordinate System Information, QINSy files

    Coordinate System information can be read directly from the DB files, so setting this information in the import wizard is not an option.



  6. Qimera will load the QINSy DB files, scanning for and extracting any available information and writing it to the Qimera project (for a full list of what is extracted from each supported format, click here). DB files will be listed in the Project Sources under the Raw Sonar Files and an indicator will show the progress of loading that individual file (1), loaded tracklines will visualize in the 4D Scene (2), and overall progress for data extraction (3) and any warnings or errors (4) will show in the Job Activity Window. Extracted information for QINSy data can include:

    • QPD files, if available

    • vessel configuration

    • position

    • heading

    • motion

    • sound velocity

    • tide and/or GPS/GNSS height corrections



    Information being extracted from the QINSy project during load.

  7. As the data loads, QPD files will be generated and written to the Qimera project. Once the data load, ancillary data extraction, and QPD write is complete, you will see the extracted vessel as well as the QPD information in the File Table (1) and can review any encountered errors in the Job Activity Window (2). All of the DB files from the project will be in the Project Sources Window under Raw Sonar Files and extracted ancillary files will be listed under the appropriate Parents (3), and all of the tracklines will be visible in the 4D Scene (4). For this example dataset, the Job Activity window displays a warning (5) that vessel system offsets are all zero (there is also a prompt that appears at the top of the 4D Scene, not shown in this image); this is discussed in the Info box above.


    File Table populated with information and errors/issues encountered in Job Activity Window.

8. As information is extracted from the QINSy files, the folders in the Qimera project get populated with the information.


Newly generated QPDs in the Qimera Project DtmData folder.


Extracted information for line 0002_Wreck_*** in the Metadata folder.

 

Extracted SVP information in the SVP folder.


File Visualization & Selection in Qimera

Checking a file on or off in the Tree View controls the visibility of the trackline; it does not effect which files are used in surface creation and processing routines.


For files to be used in a processing routine (such as surface creation), they can be checked on or off, but they must be selected . Files can be selected by clicking on the file name or trackline with the mouse (use SHIFT-click or CTRL-click to select multiple files), or by selecting the Parent level above the files in the tree view – in this example, the current Parent level would be Raw Sonar Files.


This is a key part of Qimera's workflow. For an overview of the Qimera user interface, click here. 

Note: When lines have just been added to your project and you are prompted to do a process, all of the lines that were added will automatically be included in that process