LSST Aux Tel Observing Notes

January 18 2021

Beginning shakedown for preparation for Aux Tel observing. 

Data at NCSA (have incorrect bias level so misconstructed): (Oct 2022- this is now replaced by data at SLAC repository and will not work)

• no VPNs active

• ssh stubbs@lsst-login01.ncsa.illinois.edu, cat4NCSA!, then duo authentication
  - data as FITS files are at    /project/shared/auxTel/_parent/raw/2021-01-15

• on cws laptop 

  /Users/cstubbs/data/LSSTAuxTel/ut20210118

• scp stubbs@lsst-login01.ncsa.illinois.edu:/project/shared/auxTel/_parent/raw/2021-01-15/*.fits .              requires NCSA password and then duo authentication

• can't get from NCSA to our lab machine since NCSA isn't on Harvard VPN. 

Data at summit (Does not work as of Oct 2022)

• engage tunnelblick VPN for summit network

• ssh stubbs@atshcu1.cp.lsst.org (no pwd needed)
  

• fetching data from summit to laptop, there seems to be a directory per image (these have correct bias level): 

  scp stubbs@atshcu1.cp.lsst.org:/data/ats/20210115/AT_O_20210115_000011/*.* .

display on laptop: 

ds9 -medatacube 2021011500009-det000.fits 

or

ds9 -multiframe 2021011500008-det000.fits

and even best of all

ds9 -mosaicimage iraf 2021011500009-det000.fits, which makes a tiled array

Firefly realtime display of mtn images:

start tunnelblick

https://harvard.zoom.us/j/922233063?pwd=d1VJb2lNam9Xazk0MWErWmcvMHNaUT09 then use duo authentication for astrostubbs at git

Jan 20 2021

Transferred all images from Jan 19-20 from NCSA with 
Got ~30 MB/s from NCSA to laptop at home, no VPN on. 

Aux tel analysis toolkit

Oct 2022

Data from SLAC:

setup: https://developer.lsst.io/usdf/storage.html#butler-access

https://usdf-rsp.slac.stanford.edu

Notebooks

File → new → terminal

SSH access: 

ssh into slac machine

ssh stubbs@s3dflogin.slac.stanford.edu

then do ssh rubin-devel

--------

we set up shared keys so just do ssh slac from now on.

Copying data: 

scp stubbs@s3dflogin.slac.stanford.edu:~/DATA/AT_O_20221009_000800_R00_S00.fits .

AWS console https://us-east-1.console.aws.amazon.com/ec2/home?region=us-east-1#Instances:

user cstubbs@fas.harvard.edu for AWS account
Pwd cat4cat4AWS

user name is ec2-user for AWS instance