KMC3-XPP
This is the cookbook for using bluesky at the KMC3-XPP Beamline. Many examples and many commands are explicitly written in a form that is easy for the user/operator to simply copy and paste them into the bluesky terminal as they are or with little modification.
Start Bluesky
From a terminal write
bluesky_start
Start Keithleys Screens
To start the screen for the keithlys run this line in a terminal:
phoebus_start
Then click on the file browser button and select the four Keithleys. You can also detach the screens to be able to see the four of them together.
Move motors and set values (examples)
Move motors
If you want to move a motor, or a set of motors you can simply type:
mov motor1 position1 motor2 position2
or using relative motions
movr motor1 relative_motion1 motor2 relative_motion2
A progress bar will be shown, the last number on the right is the current motor position (this works when you move only one motor)

Average measurement for each point
When measuring with the Keithleys, it is possible to instruct them to repeat the measurement n times, and return the averaged value.
To do this we have to set the parameter avg_num of the Keithley to the desired value, by default is 1. For instance, to change it to 5, for each Keithley, give the following commands
kth01.avg_type.set('Repeat')
kth01.avg_num.put(5)
kth02.avg_type.set('Repeat')
kth02.avg_num.put(5)
Set Values
If you want to set a value, for instance a new cff for the monochromator, use the following syntax
device.axis.set(value)
Change the plange grating monochromator cff
To set the cff value to 2.5 use:
sgm.cff.set(2.5)
or
pgm.cff.set(2.5)
Note that this will not produce any movement in the monochromator. The new cff will be set once you change the energy to a new one.
Magics
ctwill show a reading of all the detectorswawill show all the motor positions. You can select which motors to show using their label. For instancewa reflectometerwill show only the reflectometer motor positions.
Data
Specfile
The data are exported in a spec file, located in /home/<bluesky username>/blusky/data/beamline_commissioningYEAR.
Individual csv files
Additionally, individual csv files are exported in /home/<bluesky username>/blusky/data/beamline_commissioning/csv.
Change User
To change the folder where the single csv files are exported use the following command:
changeuser("user_name")
This will create a folder called /home/<bluesky username>/blusky/data/user_name/csv where the files will be exported.
Three kind of files will be exported for each scan:
- scanNumber_baseline.csv: here are contained the measured values for all the devices in the baseline (measured once before and once after the scan)
- scanNumber_meta.json: here are contained the metadata relative to the scan
- scanNumber_primary.csv: here are contained the data for the scan.
Scan Types
Several scan types are available by default in Bluesky. For a complete list and the documentation refer to the official documentation
Original syntax
Plans have to be passed as an argument to the Run Engine, and they are functions themselfs. For instance the count plan should be invoked like this: RE(count([noisy_det],5,delay=1))
Simplified syntax
Experimental ipython magics are available that aim to simplify the syntax. By calling the RE by the plan name, it is possible to use a spec-like syntax. For instance, the same count plan as above can be invoked like this: count [noisy_det] 5 delay=1
In case of problems, please report it to the beamline scientist and use the original syntax.
-
count: take one or more readings from detectors. Usage (5 counts, 1 sec delay):count [noisy_det] 5 delay=1
-
scanorascan: scan over one multi-motor trajectory. Usage (scan motor1 between -1 and 1 in 10 points)ascan [noisy_det] motor1 -1 1 10
-
relative_scanordscan: scan over one multi-motor trajectory relative to current position. Usage (scan motor1 between -1 and 1 in 10 points)dscan [noisy_det] motor1 -1 1 10
-
list_scan: scan over one or more variables in steps simultaneously (inner product). Usage (scan motor1 on a list of given points)dscan [noisy_det] motor1 [point1, point2, ...]
More magic...
For regular scan it is possible to simplify the syntax even more. First select the detectore, which are used most of the time and add the to the ploting detectors:
plotseect()
You can check the list for ploted detectors with:
plot_detectors
Now you can use the plans above the with an shorte syntax:
count: take one or more readings from detectors. Usage (5 counts, 1 sec delay):
* count 5 1
-
scanorascan: scan over one multi-motor trajectory. Usage (scan motor1 between -1 and 1 in 10 points)ascan motor1 -1 1 10
-
relative_scanordscan: scan over one multi-motor trajectory relative to current position. Usage (scan motor1 between -1 and 1 in 10 points)dscan motor1 -1 1 10
-
list_scan: scan over one or more variables in steps simultaneously (inner product). Usage (scan motor1 on a list of given points)dscan motor1 [point1, point2, ...]
When you use the full, magics from before list, even if you have multile detect in plot_detectors the plan will only scan the assigned detector. For example count [noisy_det] 5 delay=1 will can the [noisy_det] even if there some keithleys in plot_detectors.
Settle Time (wait before measuring)
It is possible to define a settle time, which is a a number of seconds waited by a motor before reporting that the motion is completed. For instance, to set the settle time of the pgm.en axis, use:
pgm.en.settle_time = 5
Settle Time for all motors
The following function will change the value of the settle time for all the motors to the desired value. For instance to change it to 2 or to 5 seconds use onew of the following
settle_time(2)
settle_time(5)
Add metadata to the scans
Custom metadata can be entered by the user at the execution time of a plan. Suppose that we are exectuing a plan called scan() (for brevity we omit the parameters that we need to pass to the scan function). One can add the metadata either like this:
RE(scan(), operator='John', sample='pure_gold')
Another way is to add the metadata directly in the plan. In this case we need to use a python dictionary.
RE(scan([det], motor, 1, 5, 5, md={'operator':'John', 'sample':'gold'}))
or using the symplified syntax:
scan [det] motor 1 5 5 md={'operator':'John','sample':'gold'}
Abort Motion
Weather you are moving a motor or running a plan, the motion can be interrupted by pressing ctrl+c.
This will work for the hios and the pgm.en motors.
Suspenders
Bluesky can automatically pause a measurement in case some conditions are met, by using suspenders. Two suspenders can be activated.
wait_for_injection
This suspender pause the measurements two seconds before and after the injection happens. To activate it and deactivate it use
wait_for_injections()
check_beamshutter
This suspender pause the measurements if it detects that the beamshutter or the last valve are closed. To activate it and deactivate it use
check_beamshutter()
How to write a script
Make a folder with your name in /home/opticsmasters/bluesky/user_scripts/your_name. You can then write your scripts in that folder. Examples are available in that folder /home/opticsmasters/bluesky/user_scripts/examples
The commands that are normally written in the ipython terminal should be passed as an argument to the function run_plan(), as in the examples below.
One can wriute either procedural scripts, where each line will be executed one after the other one like in the example below. To run this script just type load_user_script('examples/example_script.py'
# print the pocurrent energy of the monochromator
print(f"Current position of the PGM {pgm.en.get()}")
# move the energy to 403 eV
run_plan("mov pgm.en 403")
# run a scan
run_plan("scan [noisy_det] motor -1 1 10")
Or it is possible to define functions to call from the command line. To run this script just type load_user_script('examples/example_with_functions.py'). Now the function test_plan() is available in the ipython session, so just type test_plan() to execute it
def test_plan():
# print the pocurrent energy of the monochromator
print(f"Current position of the PGM {pgm.en.get()}")
# move the energy to 403 eV
run_plan("mov pgm.en 403")
# run a scan
run_plan("scan [noisy_det] motor -1 1 10")
Devices in the Beamline
The devices in the beamline have different components. To see the different component of a device use device.component_names. For instance, to see the component of the plane grating monochromator, called pgm, use pgm.component_names
In general one can manipulate each component by referring to it as device.component. For example the energy of the monochromator is pgm.en.
Accelerator
label: accelerator
| Motor | Description | Units |
|---|---|---|
acc.current |
The ring current | mA |
next_injection.time_next_injection |
Next injection time | sec |
Eiger2
label: apertures
Eiger2 bluesky device has the following plugins enabled:
- cam
- roi1
- roi2
- stats1
- stats2
Once we start the EIGER2, the EIGER2 IOC should be restarted. The initialization will be done by the IOC. At the first start, it's neccessary to enable plugins by running the function:
eiger.enable_plugins()
It's also neccessary to prime the plugins by:
eiger.prime_plugins()
If you need to change the folder in which the h5 and tiff images are stored please use functions from the eiger instance.
Portainer
The link to the portainer has to be added to the proxy exceptions. Portainer is availbale at this link. This address may define on the config of the docker network.
Experts Section
If you are a user, this section is not for you.
Additional command to start bluesky
Bluesky is running in containers. To restart the containers use:
bluesky_start restart
To bring down the containers:
bluesky_start down
To enter the container to debug:
bluesky_start sh
Containers Running on the local machine
This section describes which containers are running on the local machine. If you are an user, this section is of no use for you.
To visualize the running containers, you can use either Portainer (see section above), or VSCode.
Bluesky
- bluesky (The container containing the bluesky environment)
- Mongo (the database where bluesky saves the data)
- Tiled (a data-access service used to connect to the mongoDB catalog)
- Graphana (to monitor and PVs with a GUI, not necessary to run bluesky)
- MongoExpress (to monitor the usage of the MongoDB)
- Portainer (to visualize/manage the running containers)
EPICS
- Phoebus
Accelerator PVs
BPM (Beam Position Monitor)
rdX: X position readback of the beam.rdY: Y position readback of the beam.
BumpProperties (Orbit Bump Properties)
BUMPCT4R:setAng: Set angle for the UE49 bump.BPMZR:angT4H: Readback angle for the UE49 bump.ABUMPCD5R:setAng: Set angle for the UE52 bump.BPMZR:angD5H: Readback angle for the UE52 bump.FSBUMPCR:setAng: Set angle for the UE56 bump.BPMZR:angD6H: Readback angle for the UE56 bump.ABUMPCD7R:setAng: Set angle for the UE112 bump.BPMZR:angD7H: Readback angle for the UE112 bump.
BunchProperties (Special Bunch Properties)
MEASURECC:CUR:rdCurCS: Current of the camshaft bunch.MEASURECC:CUR:rdLtCS: Lifetime of the camshaft bunch.MEASURECC:CUR:setPosCS: Position setpoint for the camshaft bunch.MEASURECC:CUR:rdCurPPRE1: Current of the first pre-pre bunch.MEASURECC:CUR:rdLtPPRE1: Lifetime of the first pre-pre bunch.MEASURECC:CUR:setPosPPRE1: Position setpoint for the first pre-pre bunch.MEASURECC:CUR:rdCurPPRE2: Current of the second pre-pre bunch.MEASURECC:CUR:rdLtPPRE2: Lifetime of the second pre-pre bunch.MEASURECC:CUR:setPosPPRE2: Position setpoint for the second pre-pre bunch.MEASURECC:CUR:rdCurPTrkX: Current of the PTrkX bunch.MEASURECC:CUR:rdLtPTrkX: Lifetime of the PTrkX bunch.MEASURECC:CUR:setPosPTrkX: Position setpoint for the PTrkX bunch.MEASURECC:CUR:rdCurPTrkY: Current of the PTrkY bunch.MEASURECC:CUR:rdLtPTrkY: Lifetime of the PTrkY bunch.MEASURECC:CUR:setPosPTrkY: Position setpoint for the PTrkY bunch.MEASURECC:CUR:rdCurPTrkZ: Current of the PTrkZ bunch.MEASURECC:CUR:rdLtPTrkZ: Lifetime of the PTrkZ bunch.MEASURECC:CUR:setPosPTrkZ: Position setpoint for the PTrkZ bunch.MEASURECC:CUR:rdCurSL1: Current of the first slicing bunch.MEASURECC:CUR:rdLtSL1: Lifetime of the first slicing bunch.MEASURECC:CUR:setPosSL1: Position setpoint for the first slicing bunch.MEASURECC:CUR:rdCurSL2: Current of the second slicing bunch.MEASURECC:CUR:rdLtSL2: Lifetime of the second slicing bunch.MEASURECC:CUR:setPosSL2: Position setpoint for the second slicing bunch.MEASURECC:CUR:rdCurSL3: Current of the third slicing bunch.MEASURECC:CUR:rdLtSL3: Lifetime of the third slicing bunch.MEASURECC:CUR:setPosSL3: Position setpoint for the third slicing bunch.MEASURECC:CUR:rdCurSL4: Current of the fourth slicing bunch.MEASURECC:CUR:rdLtSL4: Lifetime of the fourth slicing bunch.MEASURECC:CUR:setPosSL4: Position setpoint for the fourth slicing bunch.MEASURECC:CUR:rdCurSL5: Current of the fifth slicing bunch.MEASURECC:CUR:rdLtSL5: Lifetime of the fifth slicing bunch.MEASURECC:CUR:setPosSL5: Position setpoint for the fifth slicing bunch.MEASURECC:CUR:rdCurSL6: Current of the sixth slicing bunch.MEASURECC:CUR:rdLtSL6: Lifetime of the sixth slicing bunch.MEASURECC:CUR:setPosSL6: Position setpoint for the sixth slicing bunch.MEASURECC:CUR:rdCurSL7: Current of the seventh slicing bunch.MEASURECC:CUR:rdLtSL7: Lifetime of the seventh slicing bunch.MEASURECC:CUR:setPosSL7: Position setpoint for the seventh slicing bunch.
TopUpMonitoring (Top-Up Injection Monitoring)
TOPUPCC:estCntDwnS: Estimated countdown time to the next injection.TOPUPCC:lastShot: Timestamp of the last injection.
DetailedAccelerator (Advanced BESSY II Operation State Information)
MDIZ3T5G:current: Current ring current.MDIZ3T5G:lt10: Overall lifetime of the beam.CUMZR:MBcurrent: Fill pattern current.TOPUPCC:message: Top-up message.TOPUPCC:stateName: Injection state name.FPATCC:mode: Mode of the fill pattern.TR1SWR:stExpBSfree: Beamshutter state.MCLKHX251C:freq: Master clock frequency.OPTICC:mode: Optics mode.FOFBCC:stAct: Fast orbit feedback correction status.RMC00V: Slow orbit correction status.