ATLAS Grid Information System

PANDA blacklisting data
Prioritized list of probes:manual (A) switcher (A) hammercloud (A) hctest1 (D)
State values:OFFLINE TEST BROKEROFF ONLINE
Experiment SitePandaQueue
Status
default
AGLT2 AGLT2_LMEM-condor switcher
AGLT2_MCORE-condor switcher
AGLT2_SL6-condor switcher
ANALY_AGLT2_SL6-condor switcher
ANALY_AGLT2_TEST_SL6-condor switcher +
ANALY_AGLT2_TIER3_TEST-condor manual
AM-04-YERPHI AM-04-YERPHI manual
ANALY_AM-04-YERPHI manual
ANLASC ALCF_Cooley manual
ALCF_Theta manual
Australia-ATLAS ANALY_AUSTRALIA_TEST manual
Australia-ATLAS_MCORE_TEST manual
Australia-ATLAS_TEST manual
BEIJING-LCG2 BEIJING-ERA_MCORE manual
BNL-ATLAS ANALY_BNL_Test_2_CE_1-condor hammercloud
ANALY_ORNL_Titan manual
BNL_Test_2_CE_1-condor hammercloud
ES_ORNL_Titan manual
HARVESTER_APF_BNL_TEST hammercloud
BNL-ATLAS-OPP ANALY_BNL_CLOUD manual
ANALY_BNL_LOCAL manual
ANALY_LONG_BNL_LOCAL manual
ATLAS_OPP_OSG-CIT_CMS_T2 hammercloud
BNL_CLOUD manual
BNL_LOCAL-condor manual
BOINC BOINC-ES manual
BOINC-TEST manual
BOINC_MCORE manual
CA-MCGILL-CLUMEQ-T2 ANALY_MCGILL_DOCKER manual
ANALY_MCGILL_TEST manual
CA-MCGILL-CLUMEQ-T2_DOCKER manual +
CA-SCINET-T2 ANALY_SCINET_TEST manual
CA-SFU-T2 ANALY_SFU_T2 manual +
ANALY_SFU_TEST manual +
CA-SFU-T2 manual +
CA-SFU-T2_MCORE manual +
CA-SFU-T2_MCORE_HIMEM manual +
CA-VICTORIA-WESTGRID-T2 ANALY_VICTORIA_TEST manual +
CA-VICTORIA-WESTGRID-T2 manual +
CERN-EXTENSION CERN-EXTENSION_HARVESTER hammercloud
CERN-EXTENSION_MCORE manual
CERN-EXTENSION_TEST manual +
CERN-PROD ANALY_CERN_SHORT manual
ANALY_CERN_T0_SHORT manual +
ANALY_CERN_TEST manual
CERN-PROD-all-prod-CEs manual
CERN-PROD-preprod_MCORE manual
CERN-PROD_CLOUD manual +
CERN-PROD_CLOUD_MCORE manual +
CERN-PROD_PUB_SCORE_SHORT manual +
CERN-PROD_T0_8MCORE manual
CERN-PROD_T0_SCORE_SHORT manual
CYFRONET-LCG2 ANALY_CYF hammercloud
CYFRONET-LCG2-all-prod-CEs hammercloud
CYFRONET-LCG2-all-prod-CEs_MCORE hammercloud
DESY-HH ANALY_DESY-HH_TEST manual
DESY-ZN ANALY_DESY-ZN_XRD manual
EELA-UNLP ANALY_UNLP hammercloud
EELA-UNLP-ce01-atlas-pbs hammercloud
FZK-LCG2 FZK-LCG2-all-prod-CEs manual +
FZK-LCG2_HIMEM manual +
FZK-LCG2_MCORE manual +
FZK-LCG2_MCORE_HI manual +
FZK-LCG2_MCORE_LO manual
FZK-LCG2_TEST manual
GR-12-TEIKAV GR-12-TEIKAV hammercloud
GRIF-IRFU GRIF-IRFU_MCORE manual +
HELIX_NEBULA HELIX_NEBULA_ATOS manual
HELIX_NEBULA_EGI manual
HEPHY-UIBK HEPHY-UIBK-grid-atlas-pbs manual +
HK-LCG2 HK-LCG2_ARC switcher +
IAAS ANALY_IAAS manual
ANALY_IAAS_TEST manual
IAAS_MCORE_HIMEM manual
IN2P3-CC IN2P3-CC_HPC_DEBUG manual +
IN2P3-CC_HPC_IDRIS_MCORE manual
IN2P3-CC_HPC_IDRIS_MCORE1 manual
IN2P3-CC-T3 IN2P3-CC-T3_MCORE manual
IN2P3-CC-T3_VM01 manual
IN2P3-CC-T3_VM02 manual
IN2P3-LAPP ANALY_LAPP_TEST hammercloud
IN2P3-LAPP-TEST hammercloud
IN2P3-LPSC IN2P3-LPSC_CLOUD manual
IN2P3-LPSC_VAC manual
INFN-COSENZA ANALY_INFN-COSENZA manual
INFN-COSENZA-linucs-ce-01-atlasglong manual
INFN-FRASCATI ANALY_INFN-FRASCATI_PODtest hammercloud
INFN-NAPOLI-ATLAS ANALY_INFN-NAPOLI manual +
ANALY_INFN-NAPOLI-RECAS switcher +
INFN-NAPOLI-ATLAS-pbs switcher
INFN-NAPOLI-ATLAS_MCORE switcher
INFN-NAPOLI-RECAS switcher
INFN-NAPOLI-RECAS-TEST switcher +
INFN-NAPOLI-RECAS_MCORE switcher
INFN-NAPOLI-SCOPE-atlasce02-sl6 switcher
INFN-ROMA2 ANALY_INFN-ROMA2 hammercloud
INFN-ROMA2-gridvm03-atlas-pbs hammercloud
INFN-T1 ANALY_INFN-T1-VWN2_TEST manual
ANALY_INFN-T1-VWN_TEST manual
ITEP ITEP_MCORE manual +
ITEP_PROD manual +
LBNL_DSD_ITB NERSC_Cori_2 manual
NERSC_Edison_2 manual
LRZ-LMU ANALY_LRZ_SL6 manual
ANALY_LRZ_TEST manual
LRZ-LMU-all-prod-CEs manual
LRZ-LMU_C2PAP manual
LRZ-LMU_C2PAP_ES_MCORE manual
LRZ-LMU_C2PAP_MCORE manual +
LRZ-LMU_MCORE manual +
LRZ-LMU_MCORE_LO manual +
LRZ-LMU_MUC1_MCORE manual +
LRZ-LMU_MUC_MCORE1 manual +
LRZ-LMU_TEST manual
MWT2 ANALY_CONNECT manual
ANALY_CONNECT_SHORT manual
ANALY_CONNECT_TEST manual
ANALY_MWT2_HIMEM manual +
ANALY_MWT2_HIMEM_MCORE manual +
ANALY_MWT2_MCORE manual +
ANALY_MWT2_SL6 manual +
CONNECT manual
CONNECT_BLUEWATERS manual
CONNECT_BLUEWATERS_MCORE manual
CONNECT_ES_BLUEWATERS manual
CONNECT_ES_BLUEWATERS_MCORE manual
CONNECT_ES_FRESNOSTATE manual +
CONNECT_ES_ICC manual +
CONNECT_ES_ICC_MCORE manual +
CONNECT_ES_JETSTREAM manual +
CONNECT_ES_JETSTREAM_MCORE manual +
CONNECT_ES_KARST manual +
CONNECT_ES_KARST_MCORE manual +
CONNECT_ES_ODYSSEY manual +
CONNECT_ES_ODYSSEY_MCORE manual +
CONNECT_ES_UIUC manual +
CONNECT_ES_UIUC_MCORE manual +
CONNECT_FRESNOSTATE manual +
CONNECT_ICCHEPT3 manual +
CONNECT_ICCHEPT3_MCORE manual +
CONNECT_JETSTREAM manual +
CONNECT_JETSTREAM_MCORE manual +
CONNECT_KARST manual +
CONNECT_KARST_MCORE manual +
CONNECT_MCORE manual
CONNECT_MIDWAY manual
CONNECT_MIDWAY_MCORE manual
CONNECT_ODYSSEY manual
CONNECT_ODYSSEY_MCORE manual +
CONNECT_RODEO manual +
CONNECT_RODEO_MCORE manual +
CONNECT_UIUC manual +
CONNECT_UIUC_MCORE manual +
MWT2_HIMEM manual +
MWT2_HIMEM_MCORE manual +
MWT2_MCORE-condor manual +
MWT2_SL6 manual +
MWT2_VHIMEM manual +
MWT2_VHIMEM_MCORE manual +
NDGF-T1 ARC-ES manual
ARC-TEST manual +
OLCF ORNL_Titan_MCORE manual
Titan_Harvester_MCORE manual
OU_OCHEP_SWT2 ANALY_OU_OCHEP_SWT2-condor manual
OUHEP_OSG switcher
OU_OSCER_ATLAS OU_OSCER_ATLAS_TEST hammercloud
PSNC PSNC-creamce-atlas-pbs_MCORE manual
RAL-Azure RAL-AZURE_VAC manual +
RAL-LCG2 ANALY_RAL_MCORE manual
ANALY_RAL_SL6 switcher
RAL-LCG2_ES switcher
RAL-LCG2_HIMEM_SL6 switcher
RAL-LCG2_MCORE manual +
RAL-LCG2_SL6 manual +
RAL-LCG2_VAC switcher
RAL-LCG2_VHIMEM switcher
RAL-LCG2-ECHO RAL-LCG2-ECHO manual +
RAL-LCG2-ECHO_MCORE manual +
RO-16-UAIC RO-16-UAIC-cream-grid-atlas-lcgpbs manual +
RRC-KI RRC-KI_TEST_DAN manual
RRC-KI-T1 RRC-KI-T1_TEST manual
SARA-MATRIX ANALY_SARA_bignode manual
ANALY_SARA_hpc_cloud manual
ANALY_SARA_hpc_cloud_rfio manual
ANALY_SARA_hpc_cloud_xrootd manual
SARA-MATRIX_LONG-all-prod-CEs hammercloud
SARA-MATRIX_MCORE manual +
SE-SNIC-T2 LUNARC_TEST hammercloud
SFU-LCG2 SFU-LCG2_ES manual +
TRIUMF-LCG2 ANALY_TRIUMF_DOCKER manual +
ANALY_TRIUMF_HIMEM manual
ANALY_TRIUMF_PPS manual
ANALY_TRIUMF_SL7 manual +
ANALY_TRIUMF_TEST manual
TRIUMF_DOCKER manual +
TRIUMF_DOCKER_MCORE manual +
TRIUMF_PPS manual
TRIUMF_SL7 manual +
TRIUMF_SL7_MCORE manual
TRIUMF_TEST manual
TUDresden-ZIH ANALY_DRESDEN manual
TUDresden-ZIH-desdemona-gridlong_scli-pbs manual
TW-FTT ANALY_TAIWAN_TEST manual
ANALY_TAIWAN_XROOTD_SL6 manual
Taiwan-LCG2 Taiwan-LCG2-HPC_HIMEM-all-prod-CEs manual
Taiwan-LCG2-HPC_VL-all-prod-CEs hammercloud
UAM-LCG2 UAM-LCG2_CREAM_HTCONDOR_MCORE_test manual
UAM-LCG2_CREAM_HTCONDOR_test manual
UKI-GRIDPP-CLOUD-IC GRIDPP_CLOUD manual
GRIDPP_MCORE manual
UKI-LT2-IC-HEP UKI-LT2-IC-HEP_SL6 manual
UKI-LT2-QMUL UKI-LT2-QMUL_TEST manual
UKI-LT2-RHUL UKI-LT2-RHUL_SL6 manual +
UKI-NORTHGRID-LANCS-HEP UKI-NORTHGRID-LANCS-HEP_CLOUD manual
UKI-NORTHGRID-LIV-HEP UKI-NORTHGRID-LIV-HEP_SL7 manual +
UKI-NORTHGRID-MAN-HEP ANALY_MANC_TEST manual
UKI-NORTHGRID-MAN-HEP_SL6 manual +
UKI-NORTHGRID-MAN-HEP_SL7 manual +
UKI-SCOTGRID-ECDF ANALY_ECDF_SL6 manual +
ANALY_ECDF_SL7 manual
UKI-ARCHER_MCORE manual
UKI-SCOTGRID-ECDF_MCORE manual
UKI-SCOTGRID-ECDF_SL6 manual
UKI-SCOTGRID-ECDF_TEST hammercloud
UKI-SCOTGRID-GLASGOW UKI-SCOTGRID-GLASGOW_TEST manual
UKI-SOUTHGRID-OX-HEP ANALY_OX_TEST hammercloud
UKI-SOUTHGRID-OX-HEP_TEST manual
UKI-SOUTHGRID-SUSX ANALY_SUSX_SL6 manual
UNI-BONN UNI-BONN hammercloud
UNIBE-LHEP UNIBE-LHEP manual +
UTA_SWT2 UTA_PAUL_TEST manual
WT2 ANALY_SLAC-lsf hammercloud
ANALY_SLAC_LMEM-lsf manual
ANALY_SLAC_SHORT_1HR-lsf manual
SLACXRD-lsf hammercloud
SLACXRD_LMEM-lsf hammercloud
SLACXRD_MP8-lsf hammercloud
SLAC_ES-lsf manual
ZA-UJ ANALY_ZA-UJ switcher +
ZA-UJ-glite-ce-pbs switcher
pic pic-htcondor-mcore manual +
pic-htcondor-score manual +
pic-ipv6-test manual
praguelcg2 Anselm_MCORE manual
praguelcg2_TEST manual
ru-Moscow-FIAN-LCG2 FIAN_MCORE switcher
FIAN_PROD switcher
Documentation: TWiki | GET API doc | POST API doc
PandaBlacklisting HOWTO (Instructions for Shifters)
  • 0. Make sure that you have required permissions granted in AGIS: PANDA-ADMIN or ATLAS-FULL. If not then do Request ADMIN privileges.
    PQ status can be changed either from shell console using CURL command or directly from Web browser by opening special page.

  • Change PQ status from console (using CURL):
    • 1. Initialize X509 proxy environment (at the moment only full legacy globus proxy is accepted)

    • $ voms-proxy-init -voms atlas --old # create proxy
    • $ export X509_USER_PROXY=/tmp/x509up_uXXXXXXX ## setup environment to point your proxy location

    • 2. Perform curl query to AGIS (check the desctiption of URI parameters below)

    • $ curl --capath /etc/grid-security/certificates --cacert $X509_USER_PROXY --cert $X509_USER_PROXY 'https://atlas-agis-api.cern.ch/request/pandaqueuestatus/update/set_probestatus/?html&pandaqueue=ANALY_CERN_TEST&value=BROKEROFF&reason=Test+API+2&probe=manual'

  • Change PQ status from Web browser:
    • 1. Ensure that your certificate is imported into a browser
    • 2. Construct and open URI like following to query AGIS:

    • https://atlas-agis-api.cern.ch/request/pandaqueuestatus/update/set_probestatus/?html&pandaqueue=ANALY_CERN_TEST&value=BROKEROFF&reason=Test+API+2&probe=manual

  • Accepted URI parameters:
    • pandaqueue: name of PandaQueue for which status will be changed
    • site (optional): ATLASSite name, to blacklist all PQs for given site
    • value: status value, possible values=[ONLINE, OFFLINE, TEST, BROKEROFF, AUTO]
    • reason: comment message (spaces should be replaced by '+')
    • probe: type of issuer. Should be 'manual' for CLI

  • Return codes:
    • For successfull operation AGIS returns following message (code=200 or code=304):
      Code=200 means that database has been successfully updated while code=304 indicates that no changes need to be applied (not modified)

      Return code: 200. Status of PanDA queue "NAME_OF_PANDAQUE" was set to "VALUE_OF_STATUS" for probe="manual", activity="a", expiration=None

    • In case of errors (code=500):

      Return code: [error code]. [Error message]

PandaBlacklisting JSON API Reference
1. To retrieve (current) data in JSON format, filter by fstate (final state) or activity values:
  • - http://atlas-agis-api.cern.ch/request/pandaqueuestatus/query/list/?json
  • - http://atlas-agis-api.cern.ch/request/pandaqueuestatus/query/list/?json&fstate=[ONLINE|OFFLINE|TEST|BROKEROFF]
  • - http://atlas-agis-api.cern.ch/request/pandaqueuestatus/query/list/?json&fstate=[..]&activity=[a1,a2]
Accepted filters:
  • fstate: filter by final states, possible values=[ONLINE, OFFLINE, TEST, BROKEROFF] | JSON example
  • activity: filter by activities, possible values: not used yet.
  • probe: filter by probe/provider name, possible value=[manual, hammercloud, switcher] | JSON example
  • pandaqueue: filter by PandaQueue name
2. Curl like API (GET requests and POST for bulk updates) to update PandaQueue blacklisting data:
  • GET is accepted HTTP method to submit data
  • To update state of PandaQueue
    1. accepted keys: probe, pandaqueue, activity, value, reason, expiration
    2. expiration key is optional and can be omitted
    3. GET URI format:
    4. -- https://atlas-agis-api.cern.ch/request/pandaqueuestatus/update/set_probestatus/?json&pandaqueue[]=PQ1&pandaqueue[]=PQ2&activity=[a]&value=[ONLINE|OFFLINE|TEST|BROKEROFF|AUTO]&reason=put+comment+here&probe=manual&expiration=2018-01-01T12:10:00
  •  
  • To blacklist whole ATLAS site (set manual state for all PandaQueues attached to the site), for specific condition (by various providers):
    1. GET URI format:
    2. -- https://atlas-agis-api.cern.ch/request/pandaqueuestatus/update/set_probestatus/?json&site[]=ATLASSite1&site[]=ATLASSite2&activity=[a]&value=[ONLINE|OFFLINE|TEST|BROKEROFF|AUTO]&probe=[hammercloud,switcher,manual]&reason=bulk+blacklist+comment&expiration=2015-07-07T12:00:00
  •  
  • RETURN codes:
  • -- API response with "true" message indicates that operation has been successfully performed, "false" message reports that operation is successfuly executed but no changes found to be commited into the DB. In case of errors, error message will be returned.
3. To retrieve the history of PandaQueue status changes in JSON format:
  • - http://atlas-agis-api.cern.ch/request/pandaqueuestatus/query/history/?json
  • - http://atlas-agis-api.cern.ch/request/pandaqueuestatus/query/history/?json&pandaqueue[]=PQ&pandaqueue[]=PQ2 | JSON example
  • - http://atlas-agis-api.cern.ch/request/pandaqueuestatus/query/history/?json&probe=[hammercloud|switched|manual]&activity=[a] | JSON example