British Astronomical Association
Supporting amateur astronomers since 1890

Secondary menu

Main menu

Home Forums Exoplanets
Terms of use

HOPS software installation

11 posts / 0 new
Last post
Offline
Last seen: 3 days 10 hours ago
Joined: 05/03/2014 - 10:05
HOPS software installation

The ARIEL Space Mission page at https://britastro.org/sites/default/files/ARIEL%20Space%20Mission%20V5.pdf has been updated to include a comprehensive guide to installing Python/HOPS software. A number of us have struggled with this installation and i must thank William Bristow for providing this update.

martinsmith's picture
Offline
Last seen: 1 week 6 days ago
Joined: 30/07/2014 - 21:31
HOPS software installation

Hi Roger,

I've installed HOPS, and reinstalled following all the steps in the guide above (including checking Python).

HOPS opens OK and I can fill in the fields. When run, the reduction frames process OK but the program becomes unresponsive when it's the turn of the observation frames, the dialogue reporting 0.0% processing. I tried a subset of the observations and some other frames from another run to no effect. 
Do you have any insight into this?
Many thanks,
Martin
Offline
Last seen: 1 week 6 days ago
Joined: 05/03/2014 - 00:00
Test Hops with known data

Hi Martin.

When you install Anaconda and Python it is important that both programs are installed in a root folder who's name contains no white space. If you installed both Anaconda and Python in the default 'user' folder and that folder is named 'Martin Smith', with a space between Martin and Smith, then my experience has been that the Python scripts that HOPS runs will fail to run properly on Windows 10.

If this applies to you, reinstall Anaconda and Python in a dedicated folder at the root of the C:\ drive and not in the default user directory.

When running a dataset, the enclosing folder should not be write protected and works ok if placed inside the usual 'My Documents' location.

While awaiting a response from Roger, carry out a test with a known good data set to determine if the problem is with the source data or with the HOPS installation.

The sample data set I recommend is the WASP-12b series available from here:

https://www.astro.louisville.edu/software/astroimagej/examples/

Select and download the raw calibration folders and uncalibrated image folder in either .zip or .tar.gz to suit your OS.

The total download size is ~4.6Gb and if experiencing problems keeping the server link active recommend using a download manager.

The raw image data coordinates for the WASP-12b data set are in decimal format, to use this set with HOPS the coordinates to be used are RA: 6  30 43.057 and DEC: +29  40  32.20.

When this particular sample data set is used, to identify and match the target and calibration stars to the SIMBAD view click the 'Flip FOV' button in HOPS.

Selected filter to be used is 'R'.

Lastly, the final fitting stage in HOPS is both CPU and memory intensive and for a large data set it may appear that nothing is happening for quite a while. The Wasp-12b set linked to above takes about five minutes to process on an iMac Pro with 12 core CPU, fast SSD and 64Gb RAM, on my small Windows laptop with an Intel i3 CPU standard HD and 8Gb RAM the same data set takes over forty minutes to process. If you are using similar hardware then allow at least fifteen to thirty minutes before assuming that HOPS has stalled.

HTH

William.

martinsmith's picture
Offline
Last seen: 1 week 6 days ago
Joined: 30/07/2014 - 21:31
Thank you William, the test

Thank you William, the test data is a good idea and will give it a go. The white space issue was covered in the installation guide and should not be a problem. I thought it might be a matter of giving enough time for processing, but I have tried being patient. Also the progress bar stays firmly at 0%. Another long time series planned for tonight so I'll have time to try your suggestions.

Thanks again,

Martin

martinsmith's picture
Offline
Last seen: 1 week 6 days ago
Joined: 30/07/2014 - 21:31
Test data

I was able to process the sample data with no problem so presumably there is an issue with my raw image files. I've attached the FITS header from one of the files, it contains less information than the sample files. Is something critical missing?

Offline
Last seen: 1 week 6 days ago
Joined: 05/03/2014 - 00:00
Skip calibration.

Hi Martin.

I can’t see anything obvious wrong with the FITS header, I don’t think HOPS has specific metadata dependencies.

Is the target in the HOPS database and are the target parameters auto loading at run time or are you manually entering the parameters for a new target previously unknown to HOPS?

Assuming the target parameters are loading/loaded correctly, try skipping the calibration frames and just run with a small set of the data frames, perhaps the data frames are being compromised during calibration, if so, running an uncalibrated set would show if that is the problem.

If HOPS still fails to solve, even when uncalibrated frames are used, upload a small set of frames to a file share service (Dropbox, Google Drive, One Drive, etc) and post a share link back here and I can try running them on the mac version of HOPS.

Two of each calibration frames and half a dozen good quality, random, data frames plus the target coordinates and target name would be enough to test.

William.

martinsmith's picture
Offline
Last seen: 1 week 6 days ago
Joined: 30/07/2014 - 21:31
It's a known target, KELT-8b.

It's a known target, KELT-8b.

Using 5 images alone reduction is swift, if I add the bias and dark frames it reduces OK too. With the images and flat frames only it takes a while but works. With all four the progam becomes unresponsive, after half an hour there is 20% progress with an unreponsive program warning. 

martinsmith's picture
Offline
Last seen: 1 week 6 days ago
Joined: 30/07/2014 - 21:31
Pre-processing

It works if the observation files are reduced separately, in the absence of an alternative this is probably the way to go.

Offline
Last seen: 1 week 6 days ago
Joined: 05/03/2014 - 00:00
Calibration frames

Martin.

The image size from the Atik 414 is small and your test with the large WASP-12b data set was successful so it can’t be a memory issue.

I tried Nebulosity in demo form many years ago but recall struggling with image calibration and correct pedestal values, often ending up with negative pixel values in the calibrated image so this problem may be related but without being able to inspect a sample of the data and calibration frames that is just a guess.

Can you try capturing data and calibration frames with different acquisition software, the ATIK capture software distributed with the camera should be ok for photometry work.

William.

martinsmith's picture
Offline
Last seen: 1 week 6 days ago
Joined: 30/07/2014 - 21:31
OK I'll try that. I not had

OK I'll try that. I not had problems with other software using images captured by Nebulosity, but it is an annoying program in some respects.

Thanks William for all your help.

Martin

Offline
Last seen: 3 days 10 hours ago
Joined: 05/03/2014 - 10:05
HOPS software installation

Hi Martin,

William knows far more about HOPS/Python than I ever will so I am sure his advice will provide the answer to your problem.

Regards