sarproz-group

Big dataset processing

Viewing 2 reply threads
  • Author
    Posts
    • #4942
      bridgetwang
      Participant

      Hi,

      I’d like to ask when I have a big dataset of 280 images, and want to process it in several subsets, can I coregister all 280 images one time, and then just select less images to form differenct subsets?

      Is it correct that just keep the images I want in ‘DataSet.txt’ to get the subset combination? I’ve tried by deleting half of the dataset in ‘DataSet.txt’, but then I get an error :”SWITCH expression must be a scalar or string constant” What does it mean?

      Another question is similar, when I import some images, and just want to keep the image pairs within e.g. 600m baselines, Is it correct that just delete the images exceeding 600m baselines in ‘DataSet.txt’ ? Because Everytime I set a threshold for baselines, some images will not be connected to the master, and matlab will warn that there are images without connections. I’m not sure should I just ingore the warning or deleting those imgs in ‘DataSet.txt’ or in the SLC folder?

      Best regards

    • #4943
      bridgetwang
      Participant

      Please find the attached error files, thanks a lot !

      Attachments:
      You must be logged in to view attached files.
    • #4946
      periz
      Keymaster

      when I have a big dataset of 280 images, and want to process it in several subsets, can I coregister all 280 images one time, and then just select less images to form differenct subsets?

      you can, it’s your option. Pros: all subsets will share the same master, so, pixels are directly comparable, you can merge/analyze results and have the full historical series. Cons: if your area is affected by temporal decorrelation/changes, keeping long temporal baselines will decrease the overall coherence.

      Is it correct that just keep the images I want in ‘DataSet.txt’ to get the subset combination? I’ve tried by deleting half of the dataset in ‘DataSet.txt’, but then I get an error :”SWITCH expression must be a scalar or string constant” What does it mean?

      yes, it is a possible way. we have no idea about the error you are getting because we do not know what you are doing. if you remove images from dataset.txt, just load your project, the software will only consider the images listed in dataset.txt. the error you get comes from SLC data processing. you do not need that module, what are you doing??

      Another question is similar, when I import some images, and just want to keep the image pairs within e.g. 600m baselines, Is it correct that just delete the images exceeding 600m baselines in ‘DataSet.txt’ ?

      no. the dataset selection module allows you to select images/image pairs to keep/exclude. you do not need to modify the dataset.txt. you can modify the dataset.txt but that’s just for removing images. if you want to keep/discard image connections, if you want to adopt different images graphs, if you want to use geometric baselines for that, it’s easier to do this via the dataset selcetion module (images/connections selection)

      best

      • #4947
        bridgetwang
        Participant

        Thank you very much for your rapid and detailed answers!

        1.

        Cons: if your area is affected by temporal decorrelation/changes, keeping long temporal baselines will decrease the overall coherence.

        For the cons you mentioned, I wonder if I individually corigester let’s say 50 images ; On the other hand, I select the same 50 images from the 280 coregisterd imgs. So the 1st and 2nd 50 images are the same, just they are coregistered to different master. And after same PSI processing, is there going to be much different result between the 1st 50 imgs and 2nd 50 imgs?

        I’d like to divide the 280 images by 2 years, meaning the temporal baseline of every subdataset is within 2 years. I suppose in this case the long temporal baselines problem won’t exist, right?

        2.
        As for the error I come across, I got this error after I delete some imgs in Dataset.txt. When I load the prohect again, I got this error. I’m sure I didn’t change the SLC folder, and already complete the coregistration. How can I fix it ?

        3.
        According to your answer, in order to keep some image connections and discard those exceeding 600m baseline threshold, I should just set the theshold via the dataset selcetion module to get the connections I want, and ignore the matlab warning? In that case, when I come to APS, it will be e.g. “Images Nr. 58 Connection Nr. 39”, is this OK for next processing ?

        Best regards

        • This reply was modified 3 weeks, 3 days ago by bridgetwang.
Viewing 2 reply threads
  • You must be logged in to reply to this topic.