You can run this notebook in Binder, in Colab, in Deepnote or in Kaggle.

[1]:
!pip install --quiet climetlab

[notice] A new release of pip available: 22.3 -> 22.3.1
[notice] To update, run: pip install --upgrade pip

Creating a shared dataset of GRIBs

[2]:
import climetlab as cml

Download data to the climetlab cache

[3]:
for month in range(1, 13): # This takes a few minutes.
    cml.load_source(
        "mars",
        param=["2t"],
        levtype="sfc",
        area=[50, -50, 20, 50],
        grid=[1, 1],
        date=f"2012-{month}",
    )

2022-12-06 14:12:29 ECMWF API python library 1.6.3
2022-12-06 14:12:29 ECMWF API at https://api.ecmwf.int/v1
2022-12-06 14:12:29 Welcome Florian Pinault
2022-12-06 14:12:30 In case of problems, please check https://confluence.ecmwf.int/display/WEBAPI/Web+API+FAQ or contact servicedesk@ecmwf.int
2022-12-06 14:12:30 Request submitted
2022-12-06 14:12:30 Request id: 638f3fbe457ff7b14dec36fc
2022-12-06 14:12:30 Request is submitted
2022-12-06 14:12:32 Request is active
2022-12-06 14:12:37 Calling 'nice mars /tmp/20221206-1310/23/tmp-_marsvHsjNS.req'
2022-12-06 14:12:37 mars - WARN -
2022-12-06 14:12:37 mars - WARN -
2022-12-06 14:12:37 MIR environment variables:
2022-12-06 14:12:37 MIR_CACHE_PATH=/data/ec_coeff
2022-12-06 14:12:37 Using MARS binary: /usr/local/apps/mars/versions/20220411095548/bin/mars.bin
2022-12-06 14:12:37 mars - INFO   - 20221206.131231 - Welcome to MARS
2022-12-06 14:12:37 mars - INFO   - 20221206.131231 - MARS Client build stamp: 20220411095548
2022-12-06 14:12:37 mars - INFO   - 20221206.131231 - MARS Client bundle version: 6.33.9.0
2022-12-06 14:12:37 mars - INFO   - 20221206.131231 - package mars-client version: 6.33.9
2022-12-06 14:12:37 mars - INFO   - 20221206.131231 - package mir version: 1.12.1
2022-12-06 14:12:37 mars - INFO   - 20221206.131231 - package odc version: 1.4.4
2022-12-06 14:12:37 mars - INFO   - 20221206.131231 - package fdb version: 5.10.7
2022-12-06 14:12:37 mars - INFO   - 20221206.131231 - package metkit version: 1.9.1
2022-12-06 14:12:37 mars - INFO   - 20221206.131231 - package eckit version: 1.19.0
2022-12-06 14:12:37 mars - INFO   - 20221206.131231 - package eccodes version: 2.25.1
2022-12-06 14:12:37 mars - INFO   - 20221206.131231 - Maximum retrieval size is 75.00 G
2022-12-06 14:12:37 retrieve,area=50.0/-50.0/20.0/50.0,levtype=sfc,param=2t,padding=0,grid=1/1,date=2012-01-01/2012-01-02/2012-01-03/2012-01-04/2012-01-05/2012-01-06/2012-01-07/2012-01-08/2012-01-09/2012-01-10/2012-01-11/2012-01-12/2012-01-13/2012-01-14/2012-01-15/2012-01-16/2012-01-17/2012-01-18/2012-01-19/2012-01-20/2012-01-21/2012-01-22/2012-01-23/2012-01-24/2012-01-25/2012-01-26/2012-01-27/2012-01-28/2012-01-29/2012-01-30/2012-01-31mars - INFO   - 20221206.131231 - Automatic split by date is on
2022-12-06 14:12:37
2022-12-06 14:12:37 mars - INFO   - 20221206.131231 - Processing request 1
2022-12-06 14:12:37
2022-12-06 14:12:37 RETRIEVE,
2022-12-06 14:12:37     CLASS      = OD,
2022-12-06 14:12:37     TYPE       = AN,
2022-12-06 14:12:37     STREAM     = OPER,
2022-12-06 14:12:37     EXPVER     = 0001,
2022-12-06 14:12:37     REPRES     = GG,
2022-12-06 14:12:37     LEVTYPE    = SFC,
2022-12-06 14:12:37     PARAM      = 167,
2022-12-06 14:12:37     TIME       = 1200,
2022-12-06 14:12:37     STEP       = 00,
2022-12-06 14:12:37     DOMAIN     = G,
2022-12-06 14:12:37     RESOL      = AUTO,
2022-12-06 14:12:37     AREA       = 50.0/-50.0/20.0/50.0,
2022-12-06 14:12:37     GRID       = 1/1,
2022-12-06 14:12:37     PADDING    = 0,
2022-12-06 14:12:37     DATE       = 20120101/20120102/20120103/20120104/20120105/20120106/20120107/20120108/20120109/20120110/20120111/20120112/20120113/20120114/20120115/20120116/20120117/20120118/20120119/20120120/20120121/20120122/20120123/20120124/20120125/20120126/20120127/20120128/20120129/20120130/20120131
2022-12-06 14:12:37
2022-12-06 14:12:37 mars - INFO   - 20221206.131231 - Web API request id: 638f3fbe457ff7b14dec36fc
2022-12-06 14:12:37 mars - INFO   - 20221206.131231 - Requesting 31 fields
2022-12-06 14:12:37 mars - INFO   - 20221206.131231 - Setting SO_SNDBUF to 33554432 (32.00 M)
2022-12-06 14:12:37 mars - INFO   - 20221206.131231 - Current value is 8192 (8.00 K)
2022-12-06 14:12:37 mars - WARN   - 20221206.131231 - SO_SNDBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:12:37 mars - INFO   - 20221206.131231 - Setting SO_RCVBUF to 33554432 (32.00 M)
2022-12-06 14:12:37 mars - INFO   - 20221206.131231 - Current value is 43690 (42.67 K)
2022-12-06 14:12:37 mars - WARN   - 20221206.131231 - SO_RCVBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:12:37 mars - INFO   - 20221206.131231 - Calling mars on 'fdbprod', local port is 46449
2022-12-06 14:12:37 mars - INFO   - 20221206.131231 - Server task is 175 [ATOS FDB]
2022-12-06 14:12:37 mars - INFO   - 20221206.131231 - Retrieving from FDB [ATOS FDB]
2022-12-06 14:12:37 mars - INFO   - 20221206.131232 - Looking up FDB indexes: 0.067791 second elapsed, 0.058788 second cpu [ATOS FDB]
2022-12-06 14:12:37 mars - INFO   - 20221206.131232 - Calling mars on 'fdbbc', local port is 59628
2022-12-06 14:12:37 mars - INFO   - 20221206.131232 - Server task is 629 [ATOS FDB BC]
2022-12-06 14:12:37 mars - INFO   - 20221206.131232 - Retrieving from FDB [ATOS FDB BC]
2022-12-06 14:12:37 mars - INFO   - 20221206.131232 - Looking up FDB indexes: 0.010776 second elapsed, 0.010705 second cpu [ATOS FDB BC]
2022-12-06 14:12:37 mars - INFO   - 20221206.131232 - Calling mars on 'marsod-core', local port is 52894
2022-12-06 14:12:37 mars - INFO   - 20221206.131232 - Server task is 762 [marsod]
2022-12-06 14:12:37 mars - INFO   - 20221206.131232 - Request cost: 31 fields, 126.654 Mbytes online, nodes: mvr010 [marsod]
2022-12-06 14:12:37 mars - INFO   - 20221206.131232 - The efficiency of your requests in the last 12 hours is 100% [marsod]
2022-12-06 14:12:37 mars - INFO   - 20221206.131232 - Transfering 132806232 bytes
2022-12-06 14:12:37 mars - INFO   - 20221206.131236 - 31 fields retrieved from 'marsod'
2022-12-06 14:12:37 mars - INFO   - 20221206.131236 - 31 fields have been interpolated
2022-12-06 14:12:37 mars - INFO   - 20221206.131236 - Request time:  wall: 4 sec
2022-12-06 14:12:37 mars - INFO   - 20221206.131236 -   Visiting marsod: wall: 4 sec
2022-12-06 14:12:37 mars - INFO   - 20221206.131236 -   Read from network: 126.65 Mbyte(s) in 3 sec  [47.62 Mbyte/sec]
2022-12-06 14:12:37 mars - INFO   - 20221206.131236 -   Writing to target file: 192.84 Kbyte(s) in < 1 sec [6.67 Mbyte/sec]
2022-12-06 14:12:37 mars - INFO   - 20221206.131236 - Memory used: 57.40 Mbyte(s)
2022-12-06 14:12:37 mars - INFO   - 20221206.131236 - No errors reported
2022-12-06 14:12:37 Process '['nice', 'mars', '/tmp/20221206-1310/23/tmp-_marsvHsjNS.req']' finished
2022-12-06 14:12:37 Request is complete
2022-12-06 14:12:37 Transfering 192.842 Kbytes into /Users/mafp/climetlab-cache/mars-retriever-c149696861938d3c643f12c313aaabd0540b395e2386d6b19ccc8f6f2ddd1b41.cache.tmp
2022-12-06 14:12:37 From https://stream.ecmwf.int/data/webmars-private-svc-blue-005/data/scratch/20221206-1310/51/_mars-webmars-private-svc-blue-005-6fe5cac1a363ec1525f54343b6cc9fd8-tg_NUX.grib
2022-12-06 14:12:37 Transfer rate 500.63 Kbytes/s
2022-12-06 14:12:38 Done
2022-12-06 14:12:38 ECMWF API python library 1.6.3
2022-12-06 14:12:38 ECMWF API at https://api.ecmwf.int/v1
2022-12-06 14:12:38 Welcome Florian Pinault
2022-12-06 14:12:39 In case of problems, please check https://confluence.ecmwf.int/display/WEBAPI/Web+API+FAQ or contact servicedesk@ecmwf.int
2022-12-06 14:12:39 Request submitted
2022-12-06 14:12:39 Request id: 638f3fc71e563c181ffa6c68
2022-12-06 14:12:39 Request is submitted
2022-12-06 14:12:41 Request is queued
2022-12-06 14:12:46 Calling 'nice mars /tmp/20221206-1310/f2/tmp-_marsKJxiOe.req'
2022-12-06 14:12:46 mars - WARN -
2022-12-06 14:12:46 mars - WARN -
2022-12-06 14:12:46 MIR environment variables:
2022-12-06 14:12:46 MIR_CACHE_PATH=/data/ec_coeff
2022-12-06 14:12:46 Using MARS binary: /usr/local/apps/mars/versions/20220411095548/bin/mars.bin
2022-12-06 14:12:46 mars - INFO   - 20221206.131241 - Welcome to MARS
2022-12-06 14:12:46 mars - INFO   - 20221206.131241 - MARS Client build stamp: 20220411095548
2022-12-06 14:12:46 mars - INFO   - 20221206.131241 - MARS Client bundle version: 6.33.9.0
2022-12-06 14:12:46 mars - INFO   - 20221206.131241 - package mars-client version: 6.33.9
2022-12-06 14:12:46 mars - INFO   - 20221206.131241 - package mir version: 1.12.1
2022-12-06 14:12:46 mars - INFO   - 20221206.131241 - package odc version: 1.4.4
2022-12-06 14:12:46 mars - INFO   - 20221206.131241 - package fdb version: 5.10.7
2022-12-06 14:12:46 mars - INFO   - 20221206.131241 - package metkit version: 1.9.1
2022-12-06 14:12:46 mars - INFO   - 20221206.131241 - package eckit version: 1.19.0
2022-12-06 14:12:46 mars - INFO   - 20221206.131241 - package eccodes version: 2.25.1
2022-12-06 14:12:46 mars - INFO   - 20221206.131241 - Maximum retrieval size is 75.00 G
2022-12-06 14:12:46 retrieve,area=50.0/-50.0/20.0/50.0,levtype=sfc,param=2t,padding=0,grid=1/1,date=2012-02-01/2012-02-02/2012-02-03/2012-02-04/2012-02-05/2012-02-06/2012-02-07/2012-02-08/2012-02-09/2012-02-10/2012-02-11/2012-02-12/2012-02-13/2012-02-14/2012-02-15/2012-02-16/2012-02-17/2012-02-18/2012-02-19/2012-02-20/2012-02-21/2012-02-22/2012-02-23/2012-02-24/2012-02-25/2012-02-26/2012-02-27/2012-02-28/2012-02-29mars - INFO   - 20221206.131241 - Automatic split by date is on
2022-12-06 14:12:46
2022-12-06 14:12:46 mars - INFO   - 20221206.131241 - Processing request 1
2022-12-06 14:12:46
2022-12-06 14:12:46 RETRIEVE,
2022-12-06 14:12:46     CLASS      = OD,
2022-12-06 14:12:46     TYPE       = AN,
2022-12-06 14:12:46     STREAM     = OPER,
2022-12-06 14:12:46     EXPVER     = 0001,
2022-12-06 14:12:46     REPRES     = GG,
2022-12-06 14:12:46     LEVTYPE    = SFC,
2022-12-06 14:12:46     PARAM      = 167,
2022-12-06 14:12:46     TIME       = 1200,
2022-12-06 14:12:46     STEP       = 00,
2022-12-06 14:12:46     DOMAIN     = G,
2022-12-06 14:12:46     RESOL      = AUTO,
2022-12-06 14:12:46     AREA       = 50.0/-50.0/20.0/50.0,
2022-12-06 14:12:46     GRID       = 1/1,
2022-12-06 14:12:46     PADDING    = 0,
2022-12-06 14:12:46     DATE       = 20120201/20120202/20120203/20120204/20120205/20120206/20120207/20120208/20120209/20120210/20120211/20120212/20120213/20120214/20120215/20120216/20120217/20120218/20120219/20120220/20120221/20120222/20120223/20120224/20120225/20120226/20120227/20120228/20120229
2022-12-06 14:12:46
2022-12-06 14:12:46 mars - INFO   - 20221206.131241 - Web API request id: 638f3fc71e563c181ffa6c68
2022-12-06 14:12:46 mars - INFO   - 20221206.131241 - Requesting 29 fields
2022-12-06 14:12:46 mars - INFO   - 20221206.131241 - Setting SO_SNDBUF to 33554432 (32.00 M)
2022-12-06 14:12:46 mars - INFO   - 20221206.131241 - Current value is 8192 (8.00 K)
2022-12-06 14:12:46 mars - WARN   - 20221206.131241 - SO_SNDBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:12:46 mars - INFO   - 20221206.131241 - Setting SO_RCVBUF to 33554432 (32.00 M)
2022-12-06 14:12:46 mars - INFO   - 20221206.131241 - Current value is 43690 (42.67 K)
2022-12-06 14:12:46 mars - WARN   - 20221206.131241 - SO_RCVBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:12:46 mars - INFO   - 20221206.131241 - Calling mars on 'fdbprod', local port is 42344
2022-12-06 14:12:46 mars - INFO   - 20221206.131241 - Server task is 860 [ATOS FDB]
2022-12-06 14:12:46 mars - INFO   - 20221206.131241 - Retrieving from FDB [ATOS FDB]
2022-12-06 14:12:46 mars - INFO   - 20221206.131241 - Looking up FDB indexes: 0.063948 second elapsed, 0.055405 second cpu [ATOS FDB]
2022-12-06 14:12:46 mars - INFO   - 20221206.131242 - Calling mars on 'fdbbc', local port is 35531
2022-12-06 14:12:46 mars - INFO   - 20221206.131242 - Server task is 900 [ATOS FDB BC]
2022-12-06 14:12:46 mars - INFO   - 20221206.131242 - Retrieving from FDB [ATOS FDB BC]
2022-12-06 14:12:46 mars - INFO   - 20221206.131242 - Looking up FDB indexes: 0.011755 second elapsed, 0.011105 second cpu [ATOS FDB BC]
2022-12-06 14:12:46 mars - INFO   - 20221206.131242 - Calling mars on 'marsod-core', local port is 39073
2022-12-06 14:12:46 mars - INFO   - 20221206.131242 - Server task is 149 [marsod]
2022-12-06 14:12:46 mars - INFO   - 20221206.131242 - Request cost: 29 fields, 118.483 Mbytes online, nodes: mvr006 [marsod]
2022-12-06 14:12:46 mars - INFO   - 20221206.131242 - The efficiency of your requests in the last 12 hours is 100% [marsod]
2022-12-06 14:12:46 mars - INFO   - 20221206.131242 - Transfering 124238088 bytes
2022-12-06 14:12:46 mars - INFO   - 20221206.131245 - 29 fields retrieved from 'marsod'
2022-12-06 14:12:46 mars - INFO   - 20221206.131245 - 29 fields have been interpolated
2022-12-06 14:12:46 mars - INFO   - 20221206.131245 - Request time:  wall: 4 sec
2022-12-06 14:12:46 mars - INFO   - 20221206.131245 -   Visiting marsod: wall: 4 sec
2022-12-06 14:12:46 mars - INFO   - 20221206.131245 -   Read from network: 118.48 Mbyte(s) in 3 sec  [46.27 Mbyte/sec]
2022-12-06 14:12:46 mars - INFO   - 20221206.131245 -   Writing to target file: 180.40 Kbyte(s) in < 1 sec [4.47 Mbyte/sec]
2022-12-06 14:12:46 mars - INFO   - 20221206.131245 - Memory used: 57.40 Mbyte(s)
2022-12-06 14:12:46 mars - INFO   - 20221206.131245 - No errors reported
2022-12-06 14:12:46 Process '['nice', 'mars', '/tmp/20221206-1310/f2/tmp-_marsKJxiOe.req']' finished
2022-12-06 14:12:46 Request is complete
2022-12-06 14:12:46 Transfering 180.4 Kbytes into /Users/mafp/climetlab-cache/mars-retriever-16ce872a11c5f3b91f39be71c8117d69944a5a738bf454cff705303b46675497.cache.tmp
2022-12-06 14:12:46 From https://stream.ecmwf.int/data/webmars-private-svc-blue-001/data/scratch/20221206-1310/08/_mars-webmars-private-svc-blue-001-6fe5cac1a363ec1525f54343b6cc9fd8-m19yiJ.grib
2022-12-06 14:12:46 Transfer rate 502.732 Kbytes/s
2022-12-06 14:12:47 Done
2022-12-06 14:12:47 ECMWF API python library 1.6.3
2022-12-06 14:12:47 ECMWF API at https://api.ecmwf.int/v1
2022-12-06 14:12:47 Welcome Florian Pinault
2022-12-06 14:12:48 In case of problems, please check https://confluence.ecmwf.int/display/WEBAPI/Web+API+FAQ or contact servicedesk@ecmwf.int
2022-12-06 14:12:48 Request submitted
2022-12-06 14:12:48 Request id: 638f3fd0ee6a8d759fec36fd
2022-12-06 14:12:48 Request is submitted
2022-12-06 14:12:49 Request is active
2022-12-06 14:12:55 Calling 'nice mars /tmp/20221206-1310/3c/tmp-_marsagQidS.req'
2022-12-06 14:12:55 mars - WARN -
2022-12-06 14:12:55 mars - WARN -
2022-12-06 14:12:55 MIR environment variables:
2022-12-06 14:12:55 MIR_CACHE_PATH=/data/ec_coeff
2022-12-06 14:12:55 Using MARS binary: /usr/local/apps/mars/versions/20220411095548/bin/mars.bin
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - Welcome to MARS
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - MARS Client build stamp: 20220411095548
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - MARS Client bundle version: 6.33.9.0
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - package mars-client version: 6.33.9
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - package mir version: 1.12.1
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - package odc version: 1.4.4
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - package fdb version: 5.10.7
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - package metkit version: 1.9.1
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - package eckit version: 1.19.0
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - package eccodes version: 2.25.1
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - Maximum retrieval size is 75.00 G
2022-12-06 14:12:55 retrieve,area=50.0/-50.0/20.0/50.0,levtype=sfc,param=2t,padding=0,grid=1/1,date=2012-03-01/2012-03-02/2012-03-03/2012-03-04/2012-03-05/2012-03-06/2012-03-07/2012-03-08/2012-03-09/2012-03-10/2012-03-11/2012-03-12/2012-03-13/2012-03-14/2012-03-15/2012-03-16/2012-03-17/2012-03-18/2012-03-19/2012-03-20/2012-03-21/2012-03-22/2012-03-23/2012-03-24/2012-03-25/2012-03-26/2012-03-27/2012-03-28/2012-03-29/2012-03-30/2012-03-31mars - INFO   - 20221206.131249 - Automatic split by date is on
2022-12-06 14:12:55
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - Processing request 1
2022-12-06 14:12:55
2022-12-06 14:12:55 RETRIEVE,
2022-12-06 14:12:55     CLASS      = OD,
2022-12-06 14:12:55     TYPE       = AN,
2022-12-06 14:12:55     STREAM     = OPER,
2022-12-06 14:12:55     EXPVER     = 0001,
2022-12-06 14:12:55     REPRES     = GG,
2022-12-06 14:12:55     LEVTYPE    = SFC,
2022-12-06 14:12:55     PARAM      = 167,
2022-12-06 14:12:55     TIME       = 1200,
2022-12-06 14:12:55     STEP       = 00,
2022-12-06 14:12:55     DOMAIN     = G,
2022-12-06 14:12:55     RESOL      = AUTO,
2022-12-06 14:12:55     AREA       = 50.0/-50.0/20.0/50.0,
2022-12-06 14:12:55     GRID       = 1/1,
2022-12-06 14:12:55     PADDING    = 0,
2022-12-06 14:12:55     DATE       = 20120301/20120302/20120303/20120304/20120305/20120306/20120307/20120308/20120309/20120310/20120311/20120312/20120313/20120314/20120315/20120316/20120317/20120318/20120319/20120320/20120321/20120322/20120323/20120324/20120325/20120326/20120327/20120328/20120329/20120330/20120331
2022-12-06 14:12:55
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - Web API request id: 638f3fd0ee6a8d759fec36fd
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - Requesting 31 fields
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - Setting SO_SNDBUF to 33554432 (32.00 M)
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - Current value is 8192 (8.00 K)
2022-12-06 14:12:55 mars - WARN   - 20221206.131249 - SO_SNDBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - Setting SO_RCVBUF to 33554432 (32.00 M)
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - Current value is 43690 (42.67 K)
2022-12-06 14:12:55 mars - WARN   - 20221206.131249 - SO_RCVBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - Calling mars on 'fdbprod', local port is 48180
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - Server task is 206 [ATOS FDB]
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - Retrieving from FDB [ATOS FDB]
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - Looking up FDB indexes: 0.070759 second elapsed, 0.060869 second cpu [ATOS FDB]
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - Calling mars on 'fdbbc', local port is 43958
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - Server task is 156 [ATOS FDB BC]
2022-12-06 14:12:55 mars - INFO   - 20221206.131249 - Retrieving from FDB [ATOS FDB BC]
2022-12-06 14:12:55 mars - INFO   - 20221206.131250 - Looking up FDB indexes: 0.012214 second elapsed, 0.011709 second cpu [ATOS FDB BC]
2022-12-06 14:12:55 mars - INFO   - 20221206.131250 - Calling mars on 'marsod-core', local port is 41660
2022-12-06 14:12:55 mars - INFO   - 20221206.131250 - Server task is 847 [marsod]
2022-12-06 14:12:55 mars - INFO   - 20221206.131250 - Request cost: 31 fields, 126.654 Mbytes online, nodes: mvr006 mvr008 [marsod]
2022-12-06 14:12:55 mars - INFO   - 20221206.131250 - The efficiency of your requests in the last 12 hours is 100% [marsod]
2022-12-06 14:12:55 mars - INFO   - 20221206.131250 - Transfering 132806232 bytes
2022-12-06 14:12:55 mars - INFO   - 20221206.131254 - 31 fields retrieved from 'marsod'
2022-12-06 14:12:55 mars - INFO   - 20221206.131254 - 31 fields have been interpolated
2022-12-06 14:12:55 mars - INFO   - 20221206.131254 - Request time:  wall: 5 sec
2022-12-06 14:12:55 mars - INFO   - 20221206.131254 -   Visiting marsod: wall: 4 sec
2022-12-06 14:12:55 mars - INFO   - 20221206.131254 -   Read from network: 126.65 Mbyte(s) in 3 sec  [38.07 Mbyte/sec]
2022-12-06 14:12:55 mars - INFO   - 20221206.131254 -   Writing to target file: 192.84 Kbyte(s) in < 1 sec [3.93 Mbyte/sec]
2022-12-06 14:12:55 mars - INFO   - 20221206.131254 - Memory used: 57.40 Mbyte(s)
2022-12-06 14:12:55 mars - INFO   - 20221206.131254 - No errors reported
2022-12-06 14:12:55 Process '['nice', 'mars', '/tmp/20221206-1310/3c/tmp-_marsagQidS.req']' finished
2022-12-06 14:12:55 Request is complete
2022-12-06 14:12:55 Transfering 192.842 Kbytes into /Users/mafp/climetlab-cache/mars-retriever-f7438015c79b0b04fd360396621e5367cd2c69b31e8cebf049c0f7bdb3212d22.cache.tmp
2022-12-06 14:12:55 From https://stream.ecmwf.int/data/webmars-private-svc-blue-004/data/scratch/20221206-1310/2c/_mars-webmars-private-svc-blue-004-6fe5cac1a363ec1525f54343b6cc9fd8-46m4wk.grib
2022-12-06 14:12:55 Transfer rate 544.041 Kbytes/s
2022-12-06 14:12:55 Done
2022-12-06 14:12:55 ECMWF API python library 1.6.3
2022-12-06 14:12:55 ECMWF API at https://api.ecmwf.int/v1
2022-12-06 14:12:56 Welcome Florian Pinault
2022-12-06 14:12:56 In case of problems, please check https://confluence.ecmwf.int/display/WEBAPI/Web+API+FAQ or contact servicedesk@ecmwf.int
2022-12-06 14:12:57 Request submitted
2022-12-06 14:12:57 Request id: 638f3fd934afd1df69ec36fa
2022-12-06 14:12:57 Request is submitted
2022-12-06 14:12:58 Request is active
2022-12-06 14:13:03 Calling 'nice mars /tmp/20221206-1310/55/tmp-_marsbYvOOd.req'
2022-12-06 14:13:03 mars - WARN -
2022-12-06 14:13:03 mars - WARN -
2022-12-06 14:13:03 MIR environment variables:
2022-12-06 14:13:03 MIR_CACHE_PATH=/data/ec_coeff
2022-12-06 14:13:03 Using MARS binary: /usr/local/apps/mars/versions/20220411095548/bin/mars.bin
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - Welcome to MARS
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - MARS Client build stamp: 20220411095548
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - MARS Client bundle version: 6.33.9.0
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - package mars-client version: 6.33.9
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - package mir version: 1.12.1
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - package odc version: 1.4.4
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - package fdb version: 5.10.7
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - package metkit version: 1.9.1
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - package eckit version: 1.19.0
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - package eccodes version: 2.25.1
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - Maximum retrieval size is 75.00 G
2022-12-06 14:13:03 retrieve,area=50.0/-50.0/20.0/50.0,levtype=sfc,param=2t,padding=0,grid=1/1,date=2012-04-01/2012-04-02/2012-04-03/2012-04-04/2012-04-05/2012-04-06/2012-04-07/2012-04-08/2012-04-09/2012-04-10/2012-04-11/2012-04-12/2012-04-13/2012-04-14/2012-04-15/2012-04-16/2012-04-17/2012-04-18/2012-04-19/2012-04-20/2012-04-21/2012-04-22/2012-04-23/2012-04-24/2012-04-25/2012-04-26/2012-04-27/2012-04-28/2012-04-29/2012-04-30mars - INFO   - 20221206.131258 - Automatic split by date is on
2022-12-06 14:13:03
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - Processing request 1
2022-12-06 14:13:03
2022-12-06 14:13:03 RETRIEVE,
2022-12-06 14:13:03     CLASS      = OD,
2022-12-06 14:13:03     TYPE       = AN,
2022-12-06 14:13:03     STREAM     = OPER,
2022-12-06 14:13:03     EXPVER     = 0001,
2022-12-06 14:13:03     REPRES     = GG,
2022-12-06 14:13:03     LEVTYPE    = SFC,
2022-12-06 14:13:03     PARAM      = 167,
2022-12-06 14:13:03     TIME       = 1200,
2022-12-06 14:13:03     STEP       = 00,
2022-12-06 14:13:03     DOMAIN     = G,
2022-12-06 14:13:03     RESOL      = AUTO,
2022-12-06 14:13:03     AREA       = 50.0/-50.0/20.0/50.0,
2022-12-06 14:13:03     GRID       = 1/1,
2022-12-06 14:13:03     PADDING    = 0,
2022-12-06 14:13:03     DATE       = 20120401/20120402/20120403/20120404/20120405/20120406/20120407/20120408/20120409/20120410/20120411/20120412/20120413/20120414/20120415/20120416/20120417/20120418/20120419/20120420/20120421/20120422/20120423/20120424/20120425/20120426/20120427/20120428/20120429/20120430
2022-12-06 14:13:03
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - Web API request id: 638f3fd934afd1df69ec36fa
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - Requesting 30 fields
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - Setting SO_SNDBUF to 33554432 (32.00 M)
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - Current value is 8192 (8.00 K)
2022-12-06 14:13:03 mars - WARN   - 20221206.131258 - SO_SNDBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - Setting SO_RCVBUF to 33554432 (32.00 M)
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - Current value is 43690 (42.67 K)
2022-12-06 14:13:03 mars - WARN   - 20221206.131258 - SO_RCVBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - Calling mars on 'fdbprod', local port is 42885
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - Server task is 479 [ATOS FDB]
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - Retrieving from FDB [ATOS FDB]
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - Looking up FDB indexes: 0.065497 second elapsed, 0.056497 second cpu [ATOS FDB]
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - Calling mars on 'fdbbc', local port is 57422
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - Server task is 827 [ATOS FDB BC]
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - Retrieving from FDB [ATOS FDB BC]
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - Looking up FDB indexes: 0.010571 second elapsed, 0.010524 second cpu [ATOS FDB BC]
2022-12-06 14:13:03 mars - INFO   - 20221206.131258 - Calling mars on 'marsod-core', local port is 57073
2022-12-06 14:13:03 mars - INFO   - 20221206.131259 - Server task is 38 [marsod]
2022-12-06 14:13:03 mars - INFO   - 20221206.131259 - Request cost: 30 fields, 122.568 Mbytes online, nodes: mvr006 mvr008 [marsod]
2022-12-06 14:13:03 mars - INFO   - 20221206.131259 - The efficiency of your requests in the last 12 hours is 100% [marsod]
2022-12-06 14:13:03 mars - INFO   - 20221206.131259 - Transfering 128522160 bytes
2022-12-06 14:13:03 mars - INFO   - 20221206.131302 - 30 fields retrieved from 'marsod'
2022-12-06 14:13:03 mars - INFO   - 20221206.131302 - 30 fields have been interpolated
2022-12-06 14:13:03 mars - INFO   - 20221206.131302 - Request time:  wall: 5 sec
2022-12-06 14:13:03 mars - INFO   - 20221206.131302 -   Visiting marsod: wall: 4 sec
2022-12-06 14:13:03 mars - INFO   - 20221206.131302 -   Read from network: 122.57 Mbyte(s) in 3 sec  [41.26 Mbyte/sec]
2022-12-06 14:13:03 mars - INFO   - 20221206.131302 -   Writing to target file: 186.62 Kbyte(s) in < 1 sec [5.51 Mbyte/sec]
2022-12-06 14:13:03 mars - INFO   - 20221206.131302 - Memory used: 57.41 Mbyte(s)
2022-12-06 14:13:03 mars - INFO   - 20221206.131302 - No errors reported
2022-12-06 14:13:03 Process '['nice', 'mars', '/tmp/20221206-1310/55/tmp-_marsbYvOOd.req']' finished
2022-12-06 14:13:03 Request is complete
2022-12-06 14:13:03 Transfering 186.621 Kbytes into /Users/mafp/climetlab-cache/mars-retriever-ed2ab4d5cd22ea26a9515feebafe0d927026108eb09acc4abf70d24b6817e4a6.cache.tmp
2022-12-06 14:13:03 From https://stream.ecmwf.int/data/webmars-private-svc-blue-011/data/scratch/20221206-1310/25/_mars-webmars-private-svc-blue-011-6fe5cac1a363ec1525f54343b6cc9fd8-YTQReE.grib
2022-12-06 14:13:04 Transfer rate 521.267 Kbytes/s
2022-12-06 14:13:04 Done
2022-12-06 14:13:04 ECMWF API python library 1.6.3
2022-12-06 14:13:04 ECMWF API at https://api.ecmwf.int/v1
2022-12-06 14:13:04 Welcome Florian Pinault
2022-12-06 14:13:05 In case of problems, please check https://confluence.ecmwf.int/display/WEBAPI/Web+API+FAQ or contact servicedesk@ecmwf.int
2022-12-06 14:13:05 Request submitted
2022-12-06 14:13:05 Request id: 638f3fe1e0c5f2f157ec3702
2022-12-06 14:13:05 Request is submitted
2022-12-06 14:13:07 Request is active
2022-12-06 14:13:12 Calling 'nice mars /tmp/20221206-1310/a3/tmp-_marshtTEhk.req'
2022-12-06 14:13:12 mars - WARN -
2022-12-06 14:13:12 mars - WARN -
2022-12-06 14:13:12 MIR environment variables:
2022-12-06 14:13:12 MIR_CACHE_PATH=/data/ec_coeff
2022-12-06 14:13:12 Using MARS binary: /usr/local/apps/mars/versions/20220411095548/bin/mars.bin
2022-12-06 14:13:12 mars - INFO   - 20221206.131306 - Welcome to MARS
2022-12-06 14:13:12 mars - INFO   - 20221206.131306 - MARS Client build stamp: 20220411095548
2022-12-06 14:13:12 mars - INFO   - 20221206.131306 - MARS Client bundle version: 6.33.9.0
2022-12-06 14:13:12 mars - INFO   - 20221206.131306 - package mars-client version: 6.33.9
2022-12-06 14:13:12 mars - INFO   - 20221206.131306 - package mir version: 1.12.1
2022-12-06 14:13:12 mars - INFO   - 20221206.131306 - package odc version: 1.4.4
2022-12-06 14:13:12 mars - INFO   - 20221206.131306 - package fdb version: 5.10.7
2022-12-06 14:13:12 mars - INFO   - 20221206.131306 - package metkit version: 1.9.1
2022-12-06 14:13:12 mars - INFO   - 20221206.131306 - package eckit version: 1.19.0
2022-12-06 14:13:12 mars - INFO   - 20221206.131306 - package eccodes version: 2.25.1
2022-12-06 14:13:12 mars - INFO   - 20221206.131306 - Maximum retrieval size is 75.00 G
2022-12-06 14:13:12 retrieve,area=50.0/-50.0/20.0/50.0,levtype=sfc,param=2t,padding=0,grid=1/1,date=2012-05-01/2012-05-02/2012-05-03/2012-05-04/2012-05-05/2012-05-06/2012-05-07/2012-05-08/2012-05-09/2012-05-10/2012-05-11/2012-05-12/2012-05-13/2012-05-14/2012-05-15/2012-05-16/2012-05-17/2012-05-18/2012-05-19/2012-05-20/2012-05-21/2012-05-22/2012-05-23/2012-05-24/2012-05-25/2012-05-26/2012-05-27/2012-05-28/2012-05-29/2012-05-30/2012-05-31mars - INFO   - 20221206.131306 - Automatic split by date is on
2022-12-06 14:13:12
2022-12-06 14:13:12 mars - INFO   - 20221206.131306 - Processing request 1
2022-12-06 14:13:12
2022-12-06 14:13:12 RETRIEVE,
2022-12-06 14:13:12     CLASS      = OD,
2022-12-06 14:13:12     TYPE       = AN,
2022-12-06 14:13:12     STREAM     = OPER,
2022-12-06 14:13:12     EXPVER     = 0001,
2022-12-06 14:13:12     REPRES     = GG,
2022-12-06 14:13:12     LEVTYPE    = SFC,
2022-12-06 14:13:12     PARAM      = 167,
2022-12-06 14:13:12     TIME       = 1200,
2022-12-06 14:13:12     STEP       = 00,
2022-12-06 14:13:12     DOMAIN     = G,
2022-12-06 14:13:12     RESOL      = AUTO,
2022-12-06 14:13:12     AREA       = 50.0/-50.0/20.0/50.0,
2022-12-06 14:13:12     GRID       = 1/1,
2022-12-06 14:13:12     PADDING    = 0,
2022-12-06 14:13:12     DATE       = 20120501/20120502/20120503/20120504/20120505/20120506/20120507/20120508/20120509/20120510/20120511/20120512/20120513/20120514/20120515/20120516/20120517/20120518/20120519/20120520/20120521/20120522/20120523/20120524/20120525/20120526/20120527/20120528/20120529/20120530/20120531
2022-12-06 14:13:12
2022-12-06 14:13:12 mars - INFO   - 20221206.131306 - Web API request id: 638f3fe1e0c5f2f157ec3702
2022-12-06 14:13:12 mars - INFO   - 20221206.131306 - Requesting 31 fields
2022-12-06 14:13:12 mars - INFO   - 20221206.131306 - Setting SO_SNDBUF to 33554432 (32.00 M)
2022-12-06 14:13:12 mars - INFO   - 20221206.131306 - Current value is 8192 (8.00 K)
2022-12-06 14:13:12 mars - WARN   - 20221206.131306 - SO_SNDBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:13:12 mars - INFO   - 20221206.131306 - Setting SO_RCVBUF to 33554432 (32.00 M)
2022-12-06 14:13:12 mars - INFO   - 20221206.131306 - Current value is 43690 (42.67 K)
2022-12-06 14:13:12 mars - WARN   - 20221206.131306 - SO_RCVBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:13:12 mars - INFO   - 20221206.131306 - Calling mars on 'fdbprod', local port is 53041
2022-12-06 14:13:12 mars - INFO   - 20221206.131306 - Server task is 906 [ATOS FDB]
2022-12-06 14:13:12 mars - INFO   - 20221206.131306 - Retrieving from FDB [ATOS FDB]
2022-12-06 14:13:12 mars - INFO   - 20221206.131307 - Looking up FDB indexes: 0.069236 second elapsed, 0.059727 second cpu [ATOS FDB]
2022-12-06 14:13:12 mars - INFO   - 20221206.131307 - Calling mars on 'fdbbc', local port is 43264
2022-12-06 14:13:12 mars - INFO   - 20221206.131307 - Server task is 827 [ATOS FDB BC]
2022-12-06 14:13:12 mars - INFO   - 20221206.131307 - Retrieving from FDB [ATOS FDB BC]
2022-12-06 14:13:12 mars - INFO   - 20221206.131307 - Looking up FDB indexes: 0.010703 second elapsed, 0.010657 second cpu [ATOS FDB BC]
2022-12-06 14:13:12 mars - INFO   - 20221206.131307 - Calling mars on 'marsod-core', local port is 59387
2022-12-06 14:13:12 mars - INFO   - 20221206.131307 - Server task is 596 [marsod]
2022-12-06 14:13:12 mars - INFO   - 20221206.131307 - Request cost: 31 fields, 126.654 Mbytes online, nodes: mvr006 [marsod]
2022-12-06 14:13:12 mars - INFO   - 20221206.131307 - The efficiency of your requests in the last 12 hours is 100% [marsod]
2022-12-06 14:13:12 mars - INFO   - 20221206.131307 - Transfering 132806232 bytes
2022-12-06 14:13:12 mars - INFO   - 20221206.131311 - 31 fields retrieved from 'marsod'
2022-12-06 14:13:12 mars - INFO   - 20221206.131311 - 31 fields have been interpolated
2022-12-06 14:13:12 mars - INFO   - 20221206.131311 - Request time:  wall: 5 sec
2022-12-06 14:13:12 mars - INFO   - 20221206.131311 -   Visiting marsod: wall: 4 sec
2022-12-06 14:13:12 mars - INFO   - 20221206.131311 -   Read from network: 126.65 Mbyte(s) in 3 sec  [41.18 Mbyte/sec]
2022-12-06 14:13:12 mars - INFO   - 20221206.131311 -   Writing to target file: 192.84 Kbyte(s) in < 1 sec [7.83 Mbyte/sec]
2022-12-06 14:13:12 mars - INFO   - 20221206.131311 - Memory used: 57.40 Mbyte(s)
2022-12-06 14:13:12 mars - INFO   - 20221206.131311 - No errors reported
2022-12-06 14:13:12 Process '['nice', 'mars', '/tmp/20221206-1310/a3/tmp-_marshtTEhk.req']' finished
2022-12-06 14:13:12 Request is complete
2022-12-06 14:13:12 Transfering 192.842 Kbytes into /Users/mafp/climetlab-cache/mars-retriever-8fb146d9165f57f748eb358800fb51258a45ab5d0eb1eed933b9f10ea5006f38.cache.tmp
2022-12-06 14:13:12 From https://stream.ecmwf.int/data/webmars-private-svc-blue-009/data/scratch/20221206-1310/da/_mars-webmars-private-svc-blue-009-6fe5cac1a363ec1525f54343b6cc9fd8-PTVik2.grib
2022-12-06 14:13:12 Transfer rate 557.681 Kbytes/s
2022-12-06 14:13:13 Done
2022-12-06 14:13:13 ECMWF API python library 1.6.3
2022-12-06 14:13:13 ECMWF API at https://api.ecmwf.int/v1
2022-12-06 14:13:13 Welcome Florian Pinault
2022-12-06 14:13:14 In case of problems, please check https://confluence.ecmwf.int/display/WEBAPI/Web+API+FAQ or contact servicedesk@ecmwf.int
2022-12-06 14:13:14 Request submitted
2022-12-06 14:13:14 Request id: 638f3feaa9264b961b87c78d
2022-12-06 14:13:14 Request is submitted
2022-12-06 14:13:15 Request is active
2022-12-06 14:13:26 Calling 'nice mars /tmp/20221206-1310/13/tmp-_marsqQX9tq.req'
2022-12-06 14:13:26 mars - WARN -
2022-12-06 14:13:26 mars - WARN -
2022-12-06 14:13:26 MIR environment variables:
2022-12-06 14:13:26 MIR_CACHE_PATH=/data/ec_coeff
2022-12-06 14:13:26 Using MARS binary: /usr/local/apps/mars/versions/20220411095548/bin/mars.bin
2022-12-06 14:13:26 mars - INFO   - 20221206.131316 - Welcome to MARS
2022-12-06 14:13:26 mars - INFO   - 20221206.131316 - MARS Client build stamp: 20220411095548
2022-12-06 14:13:26 mars - INFO   - 20221206.131316 - MARS Client bundle version: 6.33.9.0
2022-12-06 14:13:26 mars - INFO   - 20221206.131316 - package mars-client version: 6.33.9
2022-12-06 14:13:26 mars - INFO   - 20221206.131316 - package mir version: 1.12.1
2022-12-06 14:13:26 mars - INFO   - 20221206.131316 - package odc version: 1.4.4
2022-12-06 14:13:26 mars - INFO   - 20221206.131316 - package fdb version: 5.10.7
2022-12-06 14:13:26 mars - INFO   - 20221206.131316 - package metkit version: 1.9.1
2022-12-06 14:13:26 mars - INFO   - 20221206.131316 - package eckit version: 1.19.0
2022-12-06 14:13:26 mars - INFO   - 20221206.131316 - package eccodes version: 2.25.1
2022-12-06 14:13:26 mars - INFO   - 20221206.131316 - Maximum retrieval size is 75.00 G
2022-12-06 14:13:26 retrieve,area=50.0/-50.0/20.0/50.0,levtype=sfc,param=2t,padding=0,grid=1/1,date=2012-06-01/2012-06-02/2012-06-03/2012-06-04/2012-06-05/2012-06-06/2012-06-07/2012-06-08/2012-06-09/2012-06-10/2012-06-11/2012-06-12/2012-06-13/2012-06-14/2012-06-15/2012-06-16/2012-06-17/2012-06-18/2012-06-19/2012-06-20/2012-06-21/2012-06-22/2012-06-23/2012-06-24/2012-06-25/2012-06-26/2012-06-27/2012-06-28/2012-06-29/2012-06-30mars - INFO   - 20221206.131316 - Automatic split by date is on
2022-12-06 14:13:26
2022-12-06 14:13:26 mars - INFO   - 20221206.131316 - Processing request 1
2022-12-06 14:13:26
2022-12-06 14:13:26 RETRIEVE,
2022-12-06 14:13:26     CLASS      = OD,
2022-12-06 14:13:26     TYPE       = AN,
2022-12-06 14:13:26     STREAM     = OPER,
2022-12-06 14:13:26     EXPVER     = 0001,
2022-12-06 14:13:26     REPRES     = GG,
2022-12-06 14:13:26     LEVTYPE    = SFC,
2022-12-06 14:13:26     PARAM      = 167,
2022-12-06 14:13:26     TIME       = 1200,
2022-12-06 14:13:26     STEP       = 00,
2022-12-06 14:13:26     DOMAIN     = G,
2022-12-06 14:13:26     RESOL      = AUTO,
2022-12-06 14:13:26     AREA       = 50.0/-50.0/20.0/50.0,
2022-12-06 14:13:26     GRID       = 1/1,
2022-12-06 14:13:26     PADDING    = 0,
2022-12-06 14:13:26     DATE       = 20120601/20120602/20120603/20120604/20120605/20120606/20120607/20120608/20120609/20120610/20120611/20120612/20120613/20120614/20120615/20120616/20120617/20120618/20120619/20120620/20120621/20120622/20120623/20120624/20120625/20120626/20120627/20120628/20120629/20120630
2022-12-06 14:13:26
2022-12-06 14:13:26 mars - INFO   - 20221206.131316 - Web API request id: 638f3feaa9264b961b87c78d
2022-12-06 14:13:26 mars - INFO   - 20221206.131316 - Requesting 30 fields
2022-12-06 14:13:26 mars - INFO   - 20221206.131316 - Setting SO_SNDBUF to 33554432 (32.00 M)
2022-12-06 14:13:26 mars - INFO   - 20221206.131316 - Current value is 8192 (8.00 K)
2022-12-06 14:13:26 mars - WARN   - 20221206.131316 - SO_SNDBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:13:26 mars - INFO   - 20221206.131316 - Setting SO_RCVBUF to 33554432 (32.00 M)
2022-12-06 14:13:26 mars - INFO   - 20221206.131316 - Current value is 43690 (42.67 K)
2022-12-06 14:13:26 mars - WARN   - 20221206.131316 - SO_RCVBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:13:26 mars - INFO   - 20221206.131316 - Calling mars on 'fdbprod', local port is 36357
2022-12-06 14:13:26 mars - INFO   - 20221206.131316 - Server task is 210 [ATOS FDB]
2022-12-06 14:13:26 mars - INFO   - 20221206.131316 - Retrieving from FDB [ATOS FDB]
2022-12-06 14:13:26 mars - INFO   - 20221206.131316 - Looking up FDB indexes: 0.067715 second elapsed, 0.05656 second cpu [ATOS FDB]
2022-12-06 14:13:26 mars - INFO   - 20221206.131316 - Calling mars on 'fdbbc', local port is 53131
2022-12-06 14:13:26 mars - INFO   - 20221206.131317 - Server task is 401 [ATOS FDB BC]
2022-12-06 14:13:26 mars - INFO   - 20221206.131317 - Retrieving from FDB [ATOS FDB BC]
2022-12-06 14:13:26 mars - INFO   - 20221206.131317 - Looking up FDB indexes: 0.01038 second elapsed, 0.010334 second cpu [ATOS FDB BC]
2022-12-06 14:13:26 mars - INFO   - 20221206.131317 - Calling mars on 'marsod-core', local port is 35525
2022-12-06 14:13:26 mars - INFO   - 20221206.131317 - Server task is 411 [marsod]
2022-12-06 14:13:26 mars - INFO   - 20221206.131317 - Request cost: 30 fields, 122.568 Mbytes online, nodes: mvr006 mvr008 [marsod]
2022-12-06 14:13:26 mars - INFO   - 20221206.131317 - The efficiency of your requests in the last 12 hours is 100% [marsod]
2022-12-06 14:13:26 mars - INFO   - 20221206.131317 - Transfering 128522160 bytes
2022-12-06 14:13:26 mars - INFO   - 20221206.131321 - 30 fields retrieved from 'marsod'
2022-12-06 14:13:26 mars - INFO   - 20221206.131321 - 30 fields have been interpolated
2022-12-06 14:13:26 mars - INFO   - 20221206.131321 - Request time:  wall: 5 sec
2022-12-06 14:13:26 mars - INFO   - 20221206.131321 -   Visiting marsod: wall: 4 sec
2022-12-06 14:13:26 mars - INFO   - 20221206.131321 -   Read from network: 122.57 Mbyte(s) in 3 sec  [42.58 Mbyte/sec]
2022-12-06 14:13:26 mars - INFO   - 20221206.131321 -   Writing to target file: 186.62 Kbyte(s) in < 1 sec [5.13 Mbyte/sec]
2022-12-06 14:13:26 mars - INFO   - 20221206.131321 - Memory used: 57.41 Mbyte(s)
2022-12-06 14:13:26 mars - INFO   - 20221206.131321 - No errors reported
2022-12-06 14:13:26 Process '['nice', 'mars', '/tmp/20221206-1310/13/tmp-_marsqQX9tq.req']' finished
2022-12-06 14:13:26 Request is complete
2022-12-06 14:13:26 Transfering 186.621 Kbytes into /Users/mafp/climetlab-cache/mars-retriever-2f810c33e544b92eec118ecf8767615c335e5898f2413b64b758897edc6c754d.cache.tmp
2022-12-06 14:13:26 From https://stream.ecmwf.int/data/webmars-private-svc-blue-003/data/scratch/20221206-1310/f5/_mars-webmars-private-svc-blue-003-6fe5cac1a363ec1525f54343b6cc9fd8-s2LzCI.grib
2022-12-06 14:13:26 Transfer rate 550.129 Kbytes/s
2022-12-06 14:13:27 Done
2022-12-06 14:13:27 ECMWF API python library 1.6.3
2022-12-06 14:13:27 ECMWF API at https://api.ecmwf.int/v1
2022-12-06 14:13:27 Welcome Florian Pinault
2022-12-06 14:13:28 In case of problems, please check https://confluence.ecmwf.int/display/WEBAPI/Web+API+FAQ or contact servicedesk@ecmwf.int
2022-12-06 14:13:28 Request submitted
2022-12-06 14:13:28 Request id: 638f3ff8a0eb1068aafa6c6b
2022-12-06 14:13:28 Request is submitted
2022-12-06 14:13:29 Request is active
2022-12-06 14:13:35 Calling 'nice mars /tmp/20221206-1310/65/tmp-_marsBCykDD.req'
2022-12-06 14:13:35 mars - WARN -
2022-12-06 14:13:35 mars - WARN -
2022-12-06 14:13:35 MIR environment variables:
2022-12-06 14:13:35 MIR_CACHE_PATH=/data/ec_coeff
2022-12-06 14:13:35 Using MARS binary: /usr/local/apps/mars/versions/20220411095548/bin/mars.bin
2022-12-06 14:13:35 mars - INFO   - 20221206.131329 - Welcome to MARS
2022-12-06 14:13:35 mars - INFO   - 20221206.131329 - MARS Client build stamp: 20220411095548
2022-12-06 14:13:35 mars - INFO   - 20221206.131329 - MARS Client bundle version: 6.33.9.0
2022-12-06 14:13:35 mars - INFO   - 20221206.131329 - package mars-client version: 6.33.9
2022-12-06 14:13:35 mars - INFO   - 20221206.131329 - package mir version: 1.12.1
2022-12-06 14:13:35 mars - INFO   - 20221206.131329 - package odc version: 1.4.4
2022-12-06 14:13:35 mars - INFO   - 20221206.131329 - package fdb version: 5.10.7
2022-12-06 14:13:35 mars - INFO   - 20221206.131329 - package metkit version: 1.9.1
2022-12-06 14:13:35 mars - INFO   - 20221206.131329 - package eckit version: 1.19.0
2022-12-06 14:13:35 mars - INFO   - 20221206.131329 - package eccodes version: 2.25.1
2022-12-06 14:13:35 mars - INFO   - 20221206.131329 - Maximum retrieval size is 75.00 G
2022-12-06 14:13:35 retrieve,area=50.0/-50.0/20.0/50.0,levtype=sfc,param=2t,padding=0,grid=1/1,date=2012-07-01/2012-07-02/2012-07-03/2012-07-04/2012-07-05/2012-07-06/2012-07-07/2012-07-08/2012-07-09/2012-07-10/2012-07-11/2012-07-12/2012-07-13/2012-07-14/2012-07-15/2012-07-16/2012-07-17/2012-07-18/2012-07-19/2012-07-20/2012-07-21/2012-07-22/2012-07-23/2012-07-24/2012-07-25/2012-07-26/2012-07-27/2012-07-28/2012-07-29/2012-07-30/2012-07-31mars - INFO   - 20221206.131329 - Automatic split by date is on
2022-12-06 14:13:35
2022-12-06 14:13:35 mars - INFO   - 20221206.131329 - Processing request 1
2022-12-06 14:13:35
2022-12-06 14:13:35 RETRIEVE,
2022-12-06 14:13:35     CLASS      = OD,
2022-12-06 14:13:35     TYPE       = AN,
2022-12-06 14:13:35     STREAM     = OPER,
2022-12-06 14:13:35     EXPVER     = 0001,
2022-12-06 14:13:35     REPRES     = GG,
2022-12-06 14:13:35     LEVTYPE    = SFC,
2022-12-06 14:13:35     PARAM      = 167,
2022-12-06 14:13:35     TIME       = 1200,
2022-12-06 14:13:35     STEP       = 00,
2022-12-06 14:13:35     DOMAIN     = G,
2022-12-06 14:13:35     RESOL      = AUTO,
2022-12-06 14:13:35     AREA       = 50.0/-50.0/20.0/50.0,
2022-12-06 14:13:35     GRID       = 1/1,
2022-12-06 14:13:35     PADDING    = 0,
2022-12-06 14:13:35     DATE       = 20120701/20120702/20120703/20120704/20120705/20120706/20120707/20120708/20120709/20120710/20120711/20120712/20120713/20120714/20120715/20120716/20120717/20120718/20120719/20120720/20120721/20120722/20120723/20120724/20120725/20120726/20120727/20120728/20120729/20120730/20120731
2022-12-06 14:13:35
2022-12-06 14:13:35 mars - INFO   - 20221206.131329 - Web API request id: 638f3ff8a0eb1068aafa6c6b
2022-12-06 14:13:35 mars - INFO   - 20221206.131329 - Requesting 31 fields
2022-12-06 14:13:35 mars - INFO   - 20221206.131329 - Setting SO_SNDBUF to 33554432 (32.00 M)
2022-12-06 14:13:35 mars - INFO   - 20221206.131329 - Current value is 8192 (8.00 K)
2022-12-06 14:13:35 mars - WARN   - 20221206.131329 - SO_SNDBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:13:35 mars - INFO   - 20221206.131329 - Setting SO_RCVBUF to 33554432 (32.00 M)
2022-12-06 14:13:35 mars - INFO   - 20221206.131329 - Current value is 43690 (42.67 K)
2022-12-06 14:13:35 mars - WARN   - 20221206.131329 - SO_RCVBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:13:35 mars - INFO   - 20221206.131329 - Calling mars on 'fdbprod', local port is 41810
2022-12-06 14:13:35 mars - INFO   - 20221206.131329 - Server task is 519 [ATOS FDB]
2022-12-06 14:13:35 mars - INFO   - 20221206.131329 - Retrieving from FDB [ATOS FDB]
2022-12-06 14:13:35 mars - INFO   - 20221206.131329 - Looking up FDB indexes: 0.071167 second elapsed, 0.061191 second cpu [ATOS FDB]
2022-12-06 14:13:35 mars - INFO   - 20221206.131329 - Calling mars on 'fdbbc', local port is 33244
2022-12-06 14:13:35 mars - INFO   - 20221206.131330 - Server task is 172 [ATOS FDB BC]
2022-12-06 14:13:35 mars - INFO   - 20221206.131330 - Retrieving from FDB [ATOS FDB BC]
2022-12-06 14:13:35 mars - INFO   - 20221206.131330 - Looking up FDB indexes: 0.010597 second elapsed, 0.01055 second cpu [ATOS FDB BC]
2022-12-06 14:13:35 mars - INFO   - 20221206.131330 - Calling mars on 'marsod-core', local port is 45573
2022-12-06 14:13:35 mars - INFO   - 20221206.131330 - Server task is 414 [marsod]
2022-12-06 14:13:35 mars - INFO   - 20221206.131330 - Request cost: 31 fields, 126.654 Mbytes online, nodes: mvr006 [marsod]
2022-12-06 14:13:35 mars - INFO   - 20221206.131330 - The efficiency of your requests in the last 12 hours is 100% [marsod]
2022-12-06 14:13:35 mars - INFO   - 20221206.131330 - Transfering 132806232 bytes
2022-12-06 14:13:35 mars - INFO   - 20221206.131334 - 31 fields retrieved from 'marsod'
2022-12-06 14:13:35 mars - INFO   - 20221206.131334 - 31 fields have been interpolated
2022-12-06 14:13:35 mars - INFO   - 20221206.131334 - Request time:  wall: 5 sec
2022-12-06 14:13:35 mars - INFO   - 20221206.131334 -   Visiting marsod: wall: 4 sec
2022-12-06 14:13:35 mars - INFO   - 20221206.131334 -   Read from network: 126.65 Mbyte(s) in 3 sec  [42.22 Mbyte/sec]
2022-12-06 14:13:35 mars - INFO   - 20221206.131334 -   Writing to target file: 192.84 Kbyte(s) in < 1 sec [2.78 Mbyte/sec]
2022-12-06 14:13:35 mars - INFO   - 20221206.131334 - Memory used: 57.41 Mbyte(s)
2022-12-06 14:13:35 mars - INFO   - 20221206.131334 - No errors reported
2022-12-06 14:13:35 Process '['nice', 'mars', '/tmp/20221206-1310/65/tmp-_marsBCykDD.req']' finished
2022-12-06 14:13:35 Request is complete
2022-12-06 14:13:35 Transfering 192.842 Kbytes into /Users/mafp/climetlab-cache/mars-retriever-78609f47b96dc5ae0d89ec628fe90cac93ea87682176f89a4a8d3b817b1fac4e.cache.tmp
2022-12-06 14:13:35 From https://stream.ecmwf.int/data/webmars-private-svc-blue-007/data/scratch/20221206-1310/79/_mars-webmars-private-svc-blue-007-6fe5cac1a363ec1525f54343b6cc9fd8-Nnxibb.grib
2022-12-06 14:13:35 Transfer rate 562.223 Kbytes/s
2022-12-06 14:13:36 Done
2022-12-06 14:13:36 ECMWF API python library 1.6.3
2022-12-06 14:13:36 ECMWF API at https://api.ecmwf.int/v1
2022-12-06 14:13:36 Welcome Florian Pinault
2022-12-06 14:13:36 In case of problems, please check https://confluence.ecmwf.int/display/WEBAPI/Web+API+FAQ or contact servicedesk@ecmwf.int
2022-12-06 14:13:37 Request submitted
2022-12-06 14:13:37 Request id: 638f400134afd1df69ec36fb
2022-12-06 14:13:37 Request is submitted
2022-12-06 14:13:38 Request is active
2022-12-06 14:13:44 Calling 'nice mars /tmp/20221206-1310/b6/tmp-_marsgRaLbP.req'
2022-12-06 14:13:44 mars - WARN -
2022-12-06 14:13:44 mars - WARN -
2022-12-06 14:13:44 MIR environment variables:
2022-12-06 14:13:44 MIR_CACHE_PATH=/data/ec_coeff
2022-12-06 14:13:44 Using MARS binary: /usr/local/apps/mars/versions/20220411095548/bin/mars.bin
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - Welcome to MARS
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - MARS Client build stamp: 20220411095548
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - MARS Client bundle version: 6.33.9.0
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - package mars-client version: 6.33.9
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - package mir version: 1.12.1
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - package odc version: 1.4.4
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - package fdb version: 5.10.7
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - package metkit version: 1.9.1
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - package eckit version: 1.19.0
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - package eccodes version: 2.25.1
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - Maximum retrieval size is 75.00 G
2022-12-06 14:13:44 retrieve,area=50.0/-50.0/20.0/50.0,levtype=sfc,param=2t,padding=0,grid=1/1,date=2012-08-01/2012-08-02/2012-08-03/2012-08-04/2012-08-05/2012-08-06/2012-08-07/2012-08-08/2012-08-09/2012-08-10/2012-08-11/2012-08-12/2012-08-13/2012-08-14/2012-08-15/2012-08-16/2012-08-17/2012-08-18/2012-08-19/2012-08-20/2012-08-21/2012-08-22/2012-08-23/2012-08-24/2012-08-25/2012-08-26/2012-08-27/2012-08-28/2012-08-29/2012-08-30/2012-08-31mars - INFO   - 20221206.131338 - Automatic split by date is on
2022-12-06 14:13:44
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - Processing request 1
2022-12-06 14:13:44
2022-12-06 14:13:44 RETRIEVE,
2022-12-06 14:13:44     CLASS      = OD,
2022-12-06 14:13:44     TYPE       = AN,
2022-12-06 14:13:44     STREAM     = OPER,
2022-12-06 14:13:44     EXPVER     = 0001,
2022-12-06 14:13:44     REPRES     = GG,
2022-12-06 14:13:44     LEVTYPE    = SFC,
2022-12-06 14:13:44     PARAM      = 167,
2022-12-06 14:13:44     TIME       = 1200,
2022-12-06 14:13:44     STEP       = 00,
2022-12-06 14:13:44     DOMAIN     = G,
2022-12-06 14:13:44     RESOL      = AUTO,
2022-12-06 14:13:44     AREA       = 50.0/-50.0/20.0/50.0,
2022-12-06 14:13:44     GRID       = 1/1,
2022-12-06 14:13:44     PADDING    = 0,
2022-12-06 14:13:44     DATE       = 20120801/20120802/20120803/20120804/20120805/20120806/20120807/20120808/20120809/20120810/20120811/20120812/20120813/20120814/20120815/20120816/20120817/20120818/20120819/20120820/20120821/20120822/20120823/20120824/20120825/20120826/20120827/20120828/20120829/20120830/20120831
2022-12-06 14:13:44
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - Web API request id: 638f400134afd1df69ec36fb
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - Requesting 31 fields
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - Setting SO_SNDBUF to 33554432 (32.00 M)
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - Current value is 8192 (8.00 K)
2022-12-06 14:13:44 mars - WARN   - 20221206.131338 - SO_SNDBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - Setting SO_RCVBUF to 33554432 (32.00 M)
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - Current value is 43690 (42.67 K)
2022-12-06 14:13:44 mars - WARN   - 20221206.131338 - SO_RCVBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - Calling mars on 'fdbprod', local port is 46463
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - Server task is 295 [ATOS FDB]
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - Retrieving from FDB [ATOS FDB]
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - Looking up FDB indexes: 0.067627 second elapsed, 0.058883 second cpu [ATOS FDB]
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - Calling mars on 'fdbbc', local port is 54669
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - Server task is 963 [ATOS FDB BC]
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - Retrieving from FDB [ATOS FDB BC]
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - Looking up FDB indexes: 0.010788 second elapsed, 0.010721 second cpu [ATOS FDB BC]
2022-12-06 14:13:44 mars - INFO   - 20221206.131338 - Calling mars on 'marsod-core', local port is 56797
2022-12-06 14:13:44 mars - INFO   - 20221206.131339 - Server task is 414 [marsod]
2022-12-06 14:13:44 mars - INFO   - 20221206.131339 - Request cost: 31 fields, 126.654 Mbytes online, nodes: mvr004 [marsod]
2022-12-06 14:13:44 mars - INFO   - 20221206.131339 - The efficiency of your requests in the last 12 hours is 100% [marsod]
2022-12-06 14:13:44 mars - INFO   - 20221206.131339 - Transfering 132806232 bytes
2022-12-06 14:13:44 mars - INFO   - 20221206.131343 - 31 fields retrieved from 'marsod'
2022-12-06 14:13:44 mars - INFO   - 20221206.131343 - 31 fields have been interpolated
2022-12-06 14:13:44 mars - INFO   - 20221206.131343 - Request time:  wall: 5 sec
2022-12-06 14:13:44 mars - INFO   - 20221206.131343 -   Visiting marsod: wall: 4 sec
2022-12-06 14:13:44 mars - INFO   - 20221206.131343 -   Read from network: 126.65 Mbyte(s) in 3 sec  [37.62 Mbyte/sec]
2022-12-06 14:13:44 mars - INFO   - 20221206.131343 -   Writing to target file: 192.84 Kbyte(s) in < 1 sec [3.17 Mbyte/sec]
2022-12-06 14:13:44 mars - INFO   - 20221206.131343 - Memory used: 60.25 Mbyte(s)
2022-12-06 14:13:44 mars - INFO   - 20221206.131343 - No errors reported
2022-12-06 14:13:44 Process '['nice', 'mars', '/tmp/20221206-1310/b6/tmp-_marsgRaLbP.req']' finished
2022-12-06 14:13:44 Request is complete
2022-12-06 14:13:44 Transfering 192.842 Kbytes into /Users/mafp/climetlab-cache/mars-retriever-753548dc22f2ee602d291f934c5cf98f1837afcb5f1d78e5a873c7254444a674.cache.tmp
2022-12-06 14:13:44 From https://stream.ecmwf.int/data/webmars-private-svc-blue-010/data/scratch/20221206-1310/a4/_mars-webmars-private-svc-blue-010-6fe5cac1a363ec1525f54343b6cc9fd8-Qr4Y6S.grib
2022-12-06 14:13:44 Transfer rate 584.284 Kbytes/s
2022-12-06 14:13:44 Done
2022-12-06 14:13:44 ECMWF API python library 1.6.3
2022-12-06 14:13:44 ECMWF API at https://api.ecmwf.int/v1
2022-12-06 14:13:44 Welcome Florian Pinault
2022-12-06 14:13:45 In case of problems, please check https://confluence.ecmwf.int/display/WEBAPI/Web+API+FAQ or contact servicedesk@ecmwf.int
2022-12-06 14:13:45 Request submitted
2022-12-06 14:13:45 Request id: 638f400a22007ef5ea87c78d
2022-12-06 14:13:45 Request is submitted
2022-12-06 14:13:47 Request is active
2022-12-06 14:13:52 Calling 'nice mars /tmp/20221206-1310/e3/tmp-_marsmd8tnz.req'
2022-12-06 14:13:52 mars - WARN -
2022-12-06 14:13:52 mars - WARN -
2022-12-06 14:13:52 MIR environment variables:
2022-12-06 14:13:52 MIR_CACHE_PATH=/data/ec_coeff
2022-12-06 14:13:52 Using MARS binary: /usr/local/apps/mars/versions/20220411095548/bin/mars.bin
2022-12-06 14:13:52 mars - INFO   - 20221206.131346 - Welcome to MARS
2022-12-06 14:13:52 mars - INFO   - 20221206.131346 - MARS Client build stamp: 20220411095548
2022-12-06 14:13:52 mars - INFO   - 20221206.131346 - MARS Client bundle version: 6.33.9.0
2022-12-06 14:13:52 mars - INFO   - 20221206.131346 - package mars-client version: 6.33.9
2022-12-06 14:13:52 mars - INFO   - 20221206.131346 - package mir version: 1.12.1
2022-12-06 14:13:52 mars - INFO   - 20221206.131346 - package odc version: 1.4.4
2022-12-06 14:13:52 mars - INFO   - 20221206.131346 - package fdb version: 5.10.7
2022-12-06 14:13:52 mars - INFO   - 20221206.131346 - package metkit version: 1.9.1
2022-12-06 14:13:52 mars - INFO   - 20221206.131346 - package eckit version: 1.19.0
2022-12-06 14:13:52 mars - INFO   - 20221206.131346 - package eccodes version: 2.25.1
2022-12-06 14:13:52 mars - INFO   - 20221206.131346 - Maximum retrieval size is 75.00 G
2022-12-06 14:13:52 retrieve,area=50.0/-50.0/20.0/50.0,levtype=sfc,param=2t,padding=0,grid=1/1,date=2012-09-01/2012-09-02/2012-09-03/2012-09-04/2012-09-05/2012-09-06/2012-09-07/2012-09-08/2012-09-09/2012-09-10/2012-09-11/2012-09-12/2012-09-13/2012-09-14/2012-09-15/2012-09-16/2012-09-17/2012-09-18/2012-09-19/2012-09-20/2012-09-21/2012-09-22/2012-09-23/2012-09-24/2012-09-25/2012-09-26/2012-09-27/2012-09-28/2012-09-29/2012-09-30mars - INFO   - 20221206.131346 - Automatic split by date is on
2022-12-06 14:13:52
2022-12-06 14:13:52 mars - INFO   - 20221206.131346 - Processing request 1
2022-12-06 14:13:52
2022-12-06 14:13:52 RETRIEVE,
2022-12-06 14:13:52     CLASS      = OD,
2022-12-06 14:13:52     TYPE       = AN,
2022-12-06 14:13:52     STREAM     = OPER,
2022-12-06 14:13:52     EXPVER     = 0001,
2022-12-06 14:13:52     REPRES     = GG,
2022-12-06 14:13:52     LEVTYPE    = SFC,
2022-12-06 14:13:52     PARAM      = 167,
2022-12-06 14:13:52     TIME       = 1200,
2022-12-06 14:13:52     STEP       = 00,
2022-12-06 14:13:52     DOMAIN     = G,
2022-12-06 14:13:52     RESOL      = AUTO,
2022-12-06 14:13:52     AREA       = 50.0/-50.0/20.0/50.0,
2022-12-06 14:13:52     GRID       = 1/1,
2022-12-06 14:13:52     PADDING    = 0,
2022-12-06 14:13:52     DATE       = 20120901/20120902/20120903/20120904/20120905/20120906/20120907/20120908/20120909/20120910/20120911/20120912/20120913/20120914/20120915/20120916/20120917/20120918/20120919/20120920/20120921/20120922/20120923/20120924/20120925/20120926/20120927/20120928/20120929/20120930
2022-12-06 14:13:52
2022-12-06 14:13:52 mars - INFO   - 20221206.131346 - Web API request id: 638f400a22007ef5ea87c78d
2022-12-06 14:13:52 mars - INFO   - 20221206.131346 - Requesting 30 fields
2022-12-06 14:13:52 mars - INFO   - 20221206.131346 - Setting SO_SNDBUF to 33554432 (32.00 M)
2022-12-06 14:13:52 mars - INFO   - 20221206.131346 - Current value is 8192 (8.00 K)
2022-12-06 14:13:52 mars - WARN   - 20221206.131346 - SO_SNDBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:13:52 mars - INFO   - 20221206.131346 - Setting SO_RCVBUF to 33554432 (32.00 M)
2022-12-06 14:13:52 mars - INFO   - 20221206.131346 - Current value is 43690 (42.67 K)
2022-12-06 14:13:52 mars - WARN   - 20221206.131346 - SO_RCVBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:13:52 mars - INFO   - 20221206.131346 - Calling mars on 'fdbprod', local port is 37800
2022-12-06 14:13:52 mars - INFO   - 20221206.131347 - Server task is 859 [ATOS FDB]
2022-12-06 14:13:52 mars - INFO   - 20221206.131347 - Retrieving from FDB [ATOS FDB]
2022-12-06 14:13:52 mars - INFO   - 20221206.131347 - Looking up FDB indexes: 0.067506 second elapsed, 0.057294 second cpu [ATOS FDB]
2022-12-06 14:13:52 mars - INFO   - 20221206.131347 - Calling mars on 'fdbbc', local port is 41363
2022-12-06 14:13:52 mars - INFO   - 20221206.131347 - Server task is 590 [ATOS FDB BC]
2022-12-06 14:13:52 mars - INFO   - 20221206.131347 - Retrieving from FDB [ATOS FDB BC]
2022-12-06 14:13:52 mars - INFO   - 20221206.131347 - Looking up FDB indexes: 0.010566 second elapsed, 0.010515 second cpu [ATOS FDB BC]
2022-12-06 14:13:52 mars - INFO   - 20221206.131347 - Calling mars on 'marsod-core', local port is 33721
2022-12-06 14:13:52 mars - INFO   - 20221206.131347 - Server task is 829 [marsod]
2022-12-06 14:13:52 mars - INFO   - 20221206.131347 - Request cost: 30 fields, 122.568 Mbytes online, nodes: mvr007 [marsod]
2022-12-06 14:13:52 mars - INFO   - 20221206.131347 - The efficiency of your requests in the last 12 hours is 100% [marsod]
2022-12-06 14:13:52 mars - INFO   - 20221206.131347 - Transfering 128522160 bytes
2022-12-06 14:13:52 mars - INFO   - 20221206.131351 - 30 fields retrieved from 'marsod'
2022-12-06 14:13:52 mars - INFO   - 20221206.131351 - 30 fields have been interpolated
2022-12-06 14:13:52 mars - INFO   - 20221206.131351 - Request time:  wall: 5 sec
2022-12-06 14:13:52 mars - INFO   - 20221206.131351 -   Visiting marsod: wall: 4 sec
2022-12-06 14:13:52 mars - INFO   - 20221206.131351 -   Read from network: 122.57 Mbyte(s) in 3 sec  [41.61 Mbyte/sec]
2022-12-06 14:13:52 mars - INFO   - 20221206.131351 -   Writing to target file: 186.62 Kbyte(s) in < 1 sec [3.37 Mbyte/sec]
2022-12-06 14:13:52 mars - INFO   - 20221206.131351 - Memory used: 59.45 Mbyte(s)
2022-12-06 14:13:52 mars - INFO   - 20221206.131351 - No errors reported
2022-12-06 14:13:52 Process '['nice', 'mars', '/tmp/20221206-1310/e3/tmp-_marsmd8tnz.req']' finished
2022-12-06 14:13:52 Request is complete
2022-12-06 14:13:52 Transfering 186.621 Kbytes into /Users/mafp/climetlab-cache/mars-retriever-4617cd8c5d7638680756bb49bd48bb04488647ea37ffbde101bf039df9026e80.cache.tmp
2022-12-06 14:13:52 From https://stream.ecmwf.int/data/webmars-private-svc-blue-010/data/scratch/20221206-1310/0a/_mars-webmars-private-svc-blue-010-6fe5cac1a363ec1525f54343b6cc9fd8-7CyE9a.grib
2022-12-06 14:13:52 Transfer rate 581.184 Kbytes/s
2022-12-06 14:13:53 Done
2022-12-06 14:13:53 ECMWF API python library 1.6.3
2022-12-06 14:13:53 ECMWF API at https://api.ecmwf.int/v1
2022-12-06 14:13:53 Welcome Florian Pinault
2022-12-06 14:13:54 In case of problems, please check https://confluence.ecmwf.int/display/WEBAPI/Web+API+FAQ or contact servicedesk@ecmwf.int
2022-12-06 14:13:54 Request submitted
2022-12-06 14:13:54 Request id: 638f4012a0eb1068aafa6c6c
2022-12-06 14:13:54 Request is submitted
2022-12-06 14:13:56 Request is active
2022-12-06 14:14:06 Calling 'nice mars /tmp/20221206-1310/b2/tmp-_marsgytwZO.req'
2022-12-06 14:14:06 mars - WARN -
2022-12-06 14:14:06 mars - WARN -
2022-12-06 14:14:06 MIR environment variables:
2022-12-06 14:14:06 MIR_CACHE_PATH=/data/ec_coeff
2022-12-06 14:14:06 Using MARS binary: /usr/local/apps/mars/versions/20220411095548/bin/mars.bin
2022-12-06 14:14:06 mars - INFO   - 20221206.131355 - Welcome to MARS
2022-12-06 14:14:06 mars - INFO   - 20221206.131355 - MARS Client build stamp: 20220411095548
2022-12-06 14:14:06 mars - INFO   - 20221206.131355 - MARS Client bundle version: 6.33.9.0
2022-12-06 14:14:06 mars - INFO   - 20221206.131355 - package mars-client version: 6.33.9
2022-12-06 14:14:06 mars - INFO   - 20221206.131355 - package mir version: 1.12.1
2022-12-06 14:14:06 mars - INFO   - 20221206.131355 - package odc version: 1.4.4
2022-12-06 14:14:06 mars - INFO   - 20221206.131355 - package fdb version: 5.10.7
2022-12-06 14:14:06 mars - INFO   - 20221206.131355 - package metkit version: 1.9.1
2022-12-06 14:14:06 mars - INFO   - 20221206.131355 - package eckit version: 1.19.0
2022-12-06 14:14:06 mars - INFO   - 20221206.131355 - package eccodes version: 2.25.1
2022-12-06 14:14:06 mars - INFO   - 20221206.131355 - Maximum retrieval size is 75.00 G
2022-12-06 14:14:06 retrieve,area=50.0/-50.0/20.0/50.0,levtype=sfc,param=2t,padding=0,grid=1/1,date=2012-10-01/2012-10-02/2012-10-03/2012-10-04/2012-10-05/2012-10-06/2012-10-07/2012-10-08/2012-10-09/2012-10-10/2012-10-11/2012-10-12/2012-10-13/2012-10-14/2012-10-15/2012-10-16/2012-10-17/2012-10-18/2012-10-19/2012-10-20/2012-10-21/2012-10-22/2012-10-23/2012-10-24/2012-10-25/2012-10-26/2012-10-27/2012-10-28/2012-10-29/2012-10-30/2012-10-31mars - INFO   - 20221206.131355 - Automatic split by date is on
2022-12-06 14:14:06
2022-12-06 14:14:06 mars - INFO   - 20221206.131355 - Processing request 1
2022-12-06 14:14:06
2022-12-06 14:14:06 RETRIEVE,
2022-12-06 14:14:06     CLASS      = OD,
2022-12-06 14:14:06     TYPE       = AN,
2022-12-06 14:14:06     STREAM     = OPER,
2022-12-06 14:14:06     EXPVER     = 0001,
2022-12-06 14:14:06     REPRES     = GG,
2022-12-06 14:14:06     LEVTYPE    = SFC,
2022-12-06 14:14:06     PARAM      = 167,
2022-12-06 14:14:06     TIME       = 1200,
2022-12-06 14:14:06     STEP       = 00,
2022-12-06 14:14:06     DOMAIN     = G,
2022-12-06 14:14:06     RESOL      = AUTO,
2022-12-06 14:14:06     AREA       = 50.0/-50.0/20.0/50.0,
2022-12-06 14:14:06     GRID       = 1/1,
2022-12-06 14:14:06     PADDING    = 0,
2022-12-06 14:14:06     DATE       = 20121001/20121002/20121003/20121004/20121005/20121006/20121007/20121008/20121009/20121010/20121011/20121012/20121013/20121014/20121015/20121016/20121017/20121018/20121019/20121020/20121021/20121022/20121023/20121024/20121025/20121026/20121027/20121028/20121029/20121030/20121031
2022-12-06 14:14:06
2022-12-06 14:14:06 mars - INFO   - 20221206.131355 - Web API request id: 638f4012a0eb1068aafa6c6c
2022-12-06 14:14:06 mars - INFO   - 20221206.131355 - Requesting 31 fields
2022-12-06 14:14:06 mars - INFO   - 20221206.131355 - Setting SO_SNDBUF to 33554432 (32.00 M)
2022-12-06 14:14:06 mars - INFO   - 20221206.131355 - Current value is 8192 (8.00 K)
2022-12-06 14:14:06 mars - WARN   - 20221206.131355 - SO_SNDBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:14:06 mars - INFO   - 20221206.131355 - Setting SO_RCVBUF to 33554432 (32.00 M)
2022-12-06 14:14:06 mars - INFO   - 20221206.131355 - Current value is 43690 (42.67 K)
2022-12-06 14:14:06 mars - WARN   - 20221206.131355 - SO_RCVBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:14:06 mars - INFO   - 20221206.131355 - Calling mars on 'fdbprod', local port is 59678
2022-12-06 14:14:06 mars - INFO   - 20221206.131355 - Server task is 286 [ATOS FDB]
2022-12-06 14:14:06 mars - INFO   - 20221206.131355 - Retrieving from FDB [ATOS FDB]
2022-12-06 14:14:06 mars - INFO   - 20221206.131355 - Looking up FDB indexes: 0.068561 second elapsed, 0.059891 second cpu [ATOS FDB]
2022-12-06 14:14:06 mars - INFO   - 20221206.131355 - Calling mars on 'fdbbc', local port is 44256
2022-12-06 14:14:06 mars - INFO   - 20221206.131356 - Server task is 151 [ATOS FDB BC]
2022-12-06 14:14:06 mars - INFO   - 20221206.131356 - Retrieving from FDB [ATOS FDB BC]
2022-12-06 14:14:06 mars - INFO   - 20221206.131356 - Looking up FDB indexes: 0.012341 second elapsed, 0.011742 second cpu [ATOS FDB BC]
2022-12-06 14:14:06 mars - INFO   - 20221206.131356 - Calling mars on 'marsod-core', local port is 58336
2022-12-06 14:14:06 mars - INFO   - 20221206.131356 - Server task is 414 [marsod]
2022-12-06 14:14:06 mars - INFO   - 20221206.131356 - Request cost: 31 fields, 126.654 Mbytes online, nodes: mvr007 [marsod]
2022-12-06 14:14:06 mars - INFO   - 20221206.131356 - The efficiency of your requests in the last 12 hours is 100% [marsod]
2022-12-06 14:14:06 mars - INFO   - 20221206.131356 - Transfering 132806232 bytes
2022-12-06 14:14:06 mars - INFO   - 20221206.131404 - 31 fields retrieved from 'marsod'
2022-12-06 14:14:06 mars - INFO   - 20221206.131404 - 31 fields have been interpolated
2022-12-06 14:14:06 mars - INFO   - 20221206.131404 - Request time:  wall: 9 sec
2022-12-06 14:14:06 mars - INFO   - 20221206.131404 -   Visiting marsod: wall: 8 sec
2022-12-06 14:14:06 mars - INFO   - 20221206.131404 -   Read from network: 126.65 Mbyte(s) in 7 sec  [18.79 Mbyte/sec]
2022-12-06 14:14:06 mars - INFO   - 20221206.131404 -   Writing to target file: 192.84 Kbyte(s) in < 1 sec [5.91 Mbyte/sec]
2022-12-06 14:14:06 mars - INFO   - 20221206.131404 - Memory used: 59.30 Mbyte(s)
2022-12-06 14:14:06 mars - INFO   - 20221206.131404 - No errors reported
2022-12-06 14:14:06 Process '['nice', 'mars', '/tmp/20221206-1310/b2/tmp-_marsgytwZO.req']' finished
2022-12-06 14:14:06 Request is complete
2022-12-06 14:14:06 Transfering 192.842 Kbytes into /Users/mafp/climetlab-cache/mars-retriever-9486ef0e729f0dc27929c967e1583f841ebb43b20d829d05b0de3ec8c6b7e8f3.cache.tmp
2022-12-06 14:14:06 From https://stream.ecmwf.int/data/webmars-private-svc-blue-009/data/scratch/20221206-1310/8e/_mars-webmars-private-svc-blue-009-6fe5cac1a363ec1525f54343b6cc9fd8-TLpTrj.grib
2022-12-06 14:14:07 Transfer rate 555.237 Kbytes/s
2022-12-06 14:14:07 Done
2022-12-06 14:14:07 ECMWF API python library 1.6.3
2022-12-06 14:14:07 ECMWF API at https://api.ecmwf.int/v1
2022-12-06 14:14:07 Welcome Florian Pinault
2022-12-06 14:14:08 In case of problems, please check https://confluence.ecmwf.int/display/WEBAPI/Web+API+FAQ or contact servicedesk@ecmwf.int
2022-12-06 14:14:08 Request submitted
2022-12-06 14:14:08 Request id: 638f4020b3de79cd3fec36fe
2022-12-06 14:14:08 Request is submitted
2022-12-06 14:14:10 Request is active
2022-12-06 14:14:15 Calling 'nice mars /tmp/20221206-1310/e0/tmp-_marsZZZGb9.req'
2022-12-06 14:14:15 mars - WARN -
2022-12-06 14:14:15 mars - WARN -
2022-12-06 14:14:15 MIR environment variables:
2022-12-06 14:14:15 MIR_CACHE_PATH=/data/ec_coeff
2022-12-06 14:14:15 Using MARS binary: /usr/local/apps/mars/versions/20220411095548/bin/mars.bin
2022-12-06 14:14:15 mars - INFO   - 20221206.131409 - Welcome to MARS
2022-12-06 14:14:15 mars - INFO   - 20221206.131409 - MARS Client build stamp: 20220411095548
2022-12-06 14:14:15 mars - INFO   - 20221206.131409 - MARS Client bundle version: 6.33.9.0
2022-12-06 14:14:15 mars - INFO   - 20221206.131409 - package mars-client version: 6.33.9
2022-12-06 14:14:15 mars - INFO   - 20221206.131409 - package mir version: 1.12.1
2022-12-06 14:14:15 mars - INFO   - 20221206.131409 - package odc version: 1.4.4
2022-12-06 14:14:15 mars - INFO   - 20221206.131409 - package fdb version: 5.10.7
2022-12-06 14:14:15 mars - INFO   - 20221206.131409 - package metkit version: 1.9.1
2022-12-06 14:14:15 mars - INFO   - 20221206.131409 - package eckit version: 1.19.0
2022-12-06 14:14:15 mars - INFO   - 20221206.131409 - package eccodes version: 2.25.1
2022-12-06 14:14:15 mars - INFO   - 20221206.131409 - Maximum retrieval size is 75.00 G
2022-12-06 14:14:15 retrieve,area=50.0/-50.0/20.0/50.0,levtype=sfc,param=2t,padding=0,grid=1/1,date=2012-11-01/2012-11-02/2012-11-03/2012-11-04/2012-11-05/2012-11-06/2012-11-07/2012-11-08/2012-11-09/2012-11-10/2012-11-11/2012-11-12/2012-11-13/2012-11-14/2012-11-15/2012-11-16/2012-11-17/2012-11-18/2012-11-19/2012-11-20/2012-11-21/2012-11-22/2012-11-23/2012-11-24/2012-11-25/2012-11-26/2012-11-27/2012-11-28/2012-11-29/2012-11-30mars - INFO   - 20221206.131409 - Automatic split by date is on
2022-12-06 14:14:15
2022-12-06 14:14:15 mars - INFO   - 20221206.131409 - Processing request 1
2022-12-06 14:14:15
2022-12-06 14:14:15 RETRIEVE,
2022-12-06 14:14:15     CLASS      = OD,
2022-12-06 14:14:15     TYPE       = AN,
2022-12-06 14:14:15     STREAM     = OPER,
2022-12-06 14:14:15     EXPVER     = 0001,
2022-12-06 14:14:15     REPRES     = GG,
2022-12-06 14:14:15     LEVTYPE    = SFC,
2022-12-06 14:14:15     PARAM      = 167,
2022-12-06 14:14:15     TIME       = 1200,
2022-12-06 14:14:15     STEP       = 00,
2022-12-06 14:14:15     DOMAIN     = G,
2022-12-06 14:14:15     RESOL      = AUTO,
2022-12-06 14:14:15     AREA       = 50.0/-50.0/20.0/50.0,
2022-12-06 14:14:15     GRID       = 1/1,
2022-12-06 14:14:15     PADDING    = 0,
2022-12-06 14:14:15     DATE       = 20121101/20121102/20121103/20121104/20121105/20121106/20121107/20121108/20121109/20121110/20121111/20121112/20121113/20121114/20121115/20121116/20121117/20121118/20121119/20121120/20121121/20121122/20121123/20121124/20121125/20121126/20121127/20121128/20121129/20121130
2022-12-06 14:14:15
2022-12-06 14:14:15 mars - INFO   - 20221206.131409 - Web API request id: 638f4020b3de79cd3fec36fe
2022-12-06 14:14:15 mars - INFO   - 20221206.131409 - Requesting 30 fields
2022-12-06 14:14:15 mars - INFO   - 20221206.131409 - Setting SO_SNDBUF to 33554432 (32.00 M)
2022-12-06 14:14:15 mars - INFO   - 20221206.131409 - Current value is 8192 (8.00 K)
2022-12-06 14:14:15 mars - WARN   - 20221206.131409 - SO_SNDBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:14:15 mars - INFO   - 20221206.131409 - Setting SO_RCVBUF to 33554432 (32.00 M)
2022-12-06 14:14:15 mars - INFO   - 20221206.131409 - Current value is 43690 (42.67 K)
2022-12-06 14:14:15 mars - WARN   - 20221206.131409 - SO_RCVBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:14:15 mars - INFO   - 20221206.131409 - Calling mars on 'fdbprod', local port is 60393
2022-12-06 14:14:15 mars - INFO   - 20221206.131409 - Server task is 444 [ATOS FDB]
2022-12-06 14:14:15 mars - INFO   - 20221206.131409 - Retrieving from FDB [ATOS FDB]
2022-12-06 14:14:15 mars - INFO   - 20221206.131410 - Looking up FDB indexes: 0.064419 second elapsed, 0.05706 second cpu [ATOS FDB]
2022-12-06 14:14:15 mars - INFO   - 20221206.131410 - Calling mars on 'fdbbc', local port is 55191
2022-12-06 14:14:15 mars - INFO   - 20221206.131410 - Server task is 939 [ATOS FDB BC]
2022-12-06 14:14:15 mars - INFO   - 20221206.131410 - Retrieving from FDB [ATOS FDB BC]
2022-12-06 14:14:15 mars - INFO   - 20221206.131410 - Looking up FDB indexes: 0.010484 second elapsed, 0.010416 second cpu [ATOS FDB BC]
2022-12-06 14:14:15 mars - INFO   - 20221206.131410 - Calling mars on 'marsod-core', local port is 46312
2022-12-06 14:14:15 mars - INFO   - 20221206.131410 - Server task is 794 [marsod]
2022-12-06 14:14:15 mars - INFO   - 20221206.131410 - Request cost: 30 fields, 122.568 Mbytes online, nodes: mvr006 [marsod]
2022-12-06 14:14:15 mars - INFO   - 20221206.131410 - The efficiency of your requests in the last 12 hours is 100% [marsod]
2022-12-06 14:14:15 mars - INFO   - 20221206.131410 - Transfering 128522160 bytes
2022-12-06 14:14:15 mars - INFO   - 20221206.131414 - 30 fields retrieved from 'marsod'
2022-12-06 14:14:15 mars - INFO   - 20221206.131414 - 30 fields have been interpolated
2022-12-06 14:14:15 mars - INFO   - 20221206.131414 - Request time:  wall: 5 sec
2022-12-06 14:14:15 mars - INFO   - 20221206.131414 -   Visiting marsod: wall: 4 sec
2022-12-06 14:14:15 mars - INFO   - 20221206.131414 -   Read from network: 122.57 Mbyte(s) in 3 sec  [42.65 Mbyte/sec]
2022-12-06 14:14:15 mars - INFO   - 20221206.131414 -   Writing to target file: 186.62 Kbyte(s) in < 1 sec [5.53 Mbyte/sec]
2022-12-06 14:14:15 mars - INFO   - 20221206.131414 - Memory used: 57.41 Mbyte(s)
2022-12-06 14:14:15 mars - INFO   - 20221206.131414 - No errors reported
2022-12-06 14:14:15 Process '['nice', 'mars', '/tmp/20221206-1310/e0/tmp-_marsZZZGb9.req']' finished
2022-12-06 14:14:15 Request is complete
2022-12-06 14:14:15 Transfering 186.621 Kbytes into /Users/mafp/climetlab-cache/mars-retriever-7883dd45cc6f0fa0297958bc83af89b68c26dea3c51197fe44ed2c9cf80de9a4.cache.tmp
2022-12-06 14:14:15 From https://stream.ecmwf.int/data/webmars-private-svc-blue-005/data/scratch/20221206-1310/a1/_mars-webmars-private-svc-blue-005-6fe5cac1a363ec1525f54343b6cc9fd8-5Abu0x.grib
2022-12-06 14:14:15 Transfer rate 571.709 Kbytes/s
2022-12-06 14:14:16 Done
2022-12-06 14:14:16 ECMWF API python library 1.6.3
2022-12-06 14:14:16 ECMWF API at https://api.ecmwf.int/v1
2022-12-06 14:14:16 Welcome Florian Pinault
2022-12-06 14:14:17 In case of problems, please check https://confluence.ecmwf.int/display/WEBAPI/Web+API+FAQ or contact servicedesk@ecmwf.int
2022-12-06 14:14:17 Request submitted
2022-12-06 14:14:17 Request id: 638f4029428f2b53ceec3701
2022-12-06 14:14:17 Request is submitted
2022-12-06 14:14:18 Request is active
2022-12-06 14:14:24 Calling 'nice mars /tmp/20221206-1310/78/tmp-_marsEF3Ivz.req'
2022-12-06 14:14:24 mars - WARN -
2022-12-06 14:14:24 mars - WARN -
2022-12-06 14:14:24 MIR environment variables:
2022-12-06 14:14:24 MIR_CACHE_PATH=/data/ec_coeff
2022-12-06 14:14:24 Using MARS binary: /usr/local/apps/mars/versions/20220411095548/bin/mars.bin
2022-12-06 14:14:24 mars - INFO   - 20221206.131417 - Welcome to MARS
2022-12-06 14:14:24 mars - INFO   - 20221206.131417 - MARS Client build stamp: 20220411095548
2022-12-06 14:14:24 mars - INFO   - 20221206.131417 - MARS Client bundle version: 6.33.9.0
2022-12-06 14:14:24 mars - INFO   - 20221206.131417 - package mars-client version: 6.33.9
2022-12-06 14:14:24 mars - INFO   - 20221206.131417 - package mir version: 1.12.1
2022-12-06 14:14:24 mars - INFO   - 20221206.131417 - package odc version: 1.4.4
2022-12-06 14:14:24 mars - INFO   - 20221206.131417 - package fdb version: 5.10.7
2022-12-06 14:14:24 mars - INFO   - 20221206.131417 - package metkit version: 1.9.1
2022-12-06 14:14:24 mars - INFO   - 20221206.131417 - package eckit version: 1.19.0
2022-12-06 14:14:24 mars - INFO   - 20221206.131417 - package eccodes version: 2.25.1
2022-12-06 14:14:24 mars - INFO   - 20221206.131417 - Maximum retrieval size is 75.00 G
2022-12-06 14:14:24 retrieve,area=50.0/-50.0/20.0/50.0,levtype=sfc,param=2t,padding=0,grid=1/1,date=2012-12-01/2012-12-02/2012-12-03/2012-12-04/2012-12-05/2012-12-06/2012-12-07/2012-12-08/2012-12-09/2012-12-10/2012-12-11/2012-12-12/2012-12-13/2012-12-14/2012-12-15/2012-12-16/2012-12-17/2012-12-18/2012-12-19/2012-12-20/2012-12-21/2012-12-22/2012-12-23/2012-12-24/2012-12-25/2012-12-26/2012-12-27/2012-12-28/2012-12-29/2012-12-30/2012-12-31mars - INFO   - 20221206.131418 - Automatic split by date is on
2022-12-06 14:14:24
2022-12-06 14:14:24 mars - INFO   - 20221206.131418 - Processing request 1
2022-12-06 14:14:24
2022-12-06 14:14:24 RETRIEVE,
2022-12-06 14:14:24     CLASS      = OD,
2022-12-06 14:14:24     TYPE       = AN,
2022-12-06 14:14:24     STREAM     = OPER,
2022-12-06 14:14:24     EXPVER     = 0001,
2022-12-06 14:14:24     REPRES     = GG,
2022-12-06 14:14:24     LEVTYPE    = SFC,
2022-12-06 14:14:24     PARAM      = 167,
2022-12-06 14:14:24     TIME       = 1200,
2022-12-06 14:14:24     STEP       = 00,
2022-12-06 14:14:24     DOMAIN     = G,
2022-12-06 14:14:24     RESOL      = AUTO,
2022-12-06 14:14:24     AREA       = 50.0/-50.0/20.0/50.0,
2022-12-06 14:14:24     GRID       = 1/1,
2022-12-06 14:14:24     PADDING    = 0,
2022-12-06 14:14:24     DATE       = 20121201/20121202/20121203/20121204/20121205/20121206/20121207/20121208/20121209/20121210/20121211/20121212/20121213/20121214/20121215/20121216/20121217/20121218/20121219/20121220/20121221/20121222/20121223/20121224/20121225/20121226/20121227/20121228/20121229/20121230/20121231
2022-12-06 14:14:24
2022-12-06 14:14:24 mars - INFO   - 20221206.131418 - Web API request id: 638f4029428f2b53ceec3701
2022-12-06 14:14:24 mars - INFO   - 20221206.131418 - Requesting 31 fields
2022-12-06 14:14:24 mars - INFO   - 20221206.131418 - Setting SO_SNDBUF to 33554432 (32.00 M)
2022-12-06 14:14:24 mars - INFO   - 20221206.131418 - Current value is 8192 (8.00 K)
2022-12-06 14:14:24 mars - WARN   - 20221206.131418 - SO_SNDBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:14:24 mars - INFO   - 20221206.131418 - Setting SO_RCVBUF to 33554432 (32.00 M)
2022-12-06 14:14:24 mars - INFO   - 20221206.131418 - Current value is 43690 (42.67 K)
2022-12-06 14:14:24 mars - WARN   - 20221206.131418 - SO_RCVBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:14:24 mars - INFO   - 20221206.131418 - Calling mars on 'fdbprod', local port is 57962
2022-12-06 14:14:24 mars - INFO   - 20221206.131418 - Server task is 25 [ATOS FDB]
2022-12-06 14:14:24 mars - INFO   - 20221206.131418 - Retrieving from FDB [ATOS FDB]
2022-12-06 14:14:24 mars - INFO   - 20221206.131418 - Looking up FDB indexes: 0.066851 second elapsed, 0.058218 second cpu [ATOS FDB]
2022-12-06 14:14:24 mars - INFO   - 20221206.131418 - Calling mars on 'fdbbc', local port is 49045
2022-12-06 14:14:24 mars - INFO   - 20221206.131418 - Server task is 627 [ATOS FDB BC]
2022-12-06 14:14:24 mars - INFO   - 20221206.131418 - Retrieving from FDB [ATOS FDB BC]
2022-12-06 14:14:24 mars - INFO   - 20221206.131418 - Looking up FDB indexes: 0.010818 second elapsed, 0.010763 second cpu [ATOS FDB BC]
2022-12-06 14:14:24 mars - INFO   - 20221206.131418 - Calling mars on 'marsod-core', local port is 34965
2022-12-06 14:14:24 mars - INFO   - 20221206.131418 - Server task is 414 [marsod]
2022-12-06 14:14:24 mars - INFO   - 20221206.131419 - Request cost: 31 fields, 126.654 Mbytes online, nodes: mvr006 mvr008 [marsod]
2022-12-06 14:14:24 mars - INFO   - 20221206.131419 - The efficiency of your requests in the last 12 hours is 100% [marsod]
2022-12-06 14:14:24 mars - INFO   - 20221206.131419 - Transfering 132806232 bytes
2022-12-06 14:14:24 mars - INFO   - 20221206.131420 - 31 fields retrieved from 'marsod'
2022-12-06 14:14:24 mars - INFO   - 20221206.131420 - 31 fields have been interpolated
2022-12-06 14:14:24 mars - INFO   - 20221206.131420 - Request time:  wall: 3 sec
2022-12-06 14:14:24 mars - INFO   - 20221206.131420 -   Visiting marsod: wall: 2 sec
2022-12-06 14:14:24 mars - INFO   - 20221206.131420 -   Read from network: 126.65 Mbyte(s) in < 1 sec [173.49 Mbyte/sec]
2022-12-06 14:14:24 mars - INFO   - 20221206.131420 -   Writing to target file: 192.84 Kbyte(s) in < 1 sec [5.25 Mbyte/sec]
2022-12-06 14:14:24 mars - INFO   - 20221206.131420 - Memory used: 57.40 Mbyte(s)
2022-12-06 14:14:24 mars - INFO   - 20221206.131420 - No errors reported
2022-12-06 14:14:24 Process '['nice', 'mars', '/tmp/20221206-1310/78/tmp-_marsEF3Ivz.req']' finished
2022-12-06 14:14:24 Request is complete
2022-12-06 14:14:24 Transfering 192.842 Kbytes into /Users/mafp/climetlab-cache/mars-retriever-a151e7fcd829068805a01b5f2b694270115f449fa2fda96ed292122c0452cd9c.cache.tmp
2022-12-06 14:14:24 From https://stream.ecmwf.int/data/webmars-private-svc-blue-001/data/scratch/20221206-1310/be/_mars-webmars-private-svc-blue-001-6fe5cac1a363ec1525f54343b6cc9fd8-XAI5kd.grib
2022-12-06 14:14:24 Transfer rate 564.737 Kbytes/s
2022-12-06 14:14:24 Done
[4]:

cml.load_source( "mars", param="msl", levtype="sfc", area=[50, -50, 20, 50], grid=[1, 1], date="2012-12-01", );
2022-12-06 14:14:24 ECMWF API python library 1.6.3
2022-12-06 14:14:24 ECMWF API at https://api.ecmwf.int/v1
2022-12-06 14:14:25 Welcome Florian Pinault
2022-12-06 14:14:25 In case of problems, please check https://confluence.ecmwf.int/display/WEBAPI/Web+API+FAQ or contact servicedesk@ecmwf.int
2022-12-06 14:14:26 Request submitted
2022-12-06 14:14:26 Request id: 638f40323677e48ef887c792
2022-12-06 14:14:26 Request is submitted
2022-12-06 14:14:27 Request is active
2022-12-06 14:14:32 Calling 'nice mars /tmp/20221206-1310/64/tmp-_marst1S1si.req'
2022-12-06 14:14:32 mars - WARN -
2022-12-06 14:14:32 mars - WARN -
2022-12-06 14:14:32 MIR environment variables:
2022-12-06 14:14:32 MIR_CACHE_PATH=/data/ec_coeff
2022-12-06 14:14:32 Using MARS binary: /usr/local/apps/mars/versions/20220411095548/bin/mars.bin
2022-12-06 14:14:32 mars - INFO   - 20221206.131426 - Welcome to MARS
2022-12-06 14:14:32 mars - INFO   - 20221206.131426 - MARS Client build stamp: 20220411095548
2022-12-06 14:14:32 mars - INFO   - 20221206.131426 - MARS Client bundle version: 6.33.9.0
2022-12-06 14:14:32 mars - INFO   - 20221206.131426 - package mars-client version: 6.33.9
2022-12-06 14:14:32 mars - INFO   - 20221206.131426 - package mir version: 1.12.1
2022-12-06 14:14:32 mars - INFO   - 20221206.131426 - package odc version: 1.4.4
2022-12-06 14:14:32 mars - INFO   - 20221206.131426 - package fdb version: 5.10.7
2022-12-06 14:14:32 mars - INFO   - 20221206.131426 - package metkit version: 1.9.1
2022-12-06 14:14:32 mars - INFO   - 20221206.131426 - package eckit version: 1.19.0
2022-12-06 14:14:32 mars - INFO   - 20221206.131426 - package eccodes version: 2.25.1
2022-12-06 14:14:32 mars - INFO   - 20221206.131426 - Maximum retrieval size is 75.00 G
2022-12-06 14:14:32 retrieve,area=50.0/-50.0/20.0/50.0,levtype=sfc,param=msl,padding=0,grid=1/1,date=2012-12-01mars - INFO   - 20221206.131426 - Automatic split by date is on
2022-12-06 14:14:32
2022-12-06 14:14:32 mars - INFO   - 20221206.131426 - Processing request 1
2022-12-06 14:14:32
2022-12-06 14:14:32 RETRIEVE,
2022-12-06 14:14:32     CLASS      = OD,
2022-12-06 14:14:32     TYPE       = AN,
2022-12-06 14:14:32     STREAM     = OPER,
2022-12-06 14:14:32     EXPVER     = 0001,
2022-12-06 14:14:32     REPRES     = GG,
2022-12-06 14:14:32     LEVTYPE    = SFC,
2022-12-06 14:14:32     PARAM      = 151,
2022-12-06 14:14:32     TIME       = 1200,
2022-12-06 14:14:32     STEP       = 00,
2022-12-06 14:14:32     DOMAIN     = G,
2022-12-06 14:14:32     RESOL      = AUTO,
2022-12-06 14:14:32     AREA       = 50.0/-50.0/20.0/50.0,
2022-12-06 14:14:32     GRID       = 1/1,
2022-12-06 14:14:32     PADDING    = 0,
2022-12-06 14:14:32     DATE       = 20121201
2022-12-06 14:14:32
2022-12-06 14:14:32 mars - INFO   - 20221206.131426 - Web API request id: 638f40323677e48ef887c792
2022-12-06 14:14:32 mars - INFO   - 20221206.131426 - Requesting 1 field
2022-12-06 14:14:32 mars - INFO   - 20221206.131426 - Setting SO_SNDBUF to 33554432 (32.00 M)
2022-12-06 14:14:32 mars - INFO   - 20221206.131426 - Current value is 8192 (8.00 K)
2022-12-06 14:14:32 mars - WARN   - 20221206.131426 - SO_SNDBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:14:32 mars - INFO   - 20221206.131426 - Setting SO_RCVBUF to 33554432 (32.00 M)
2022-12-06 14:14:32 mars - INFO   - 20221206.131426 - Current value is 43690 (42.67 K)
2022-12-06 14:14:32 mars - WARN   - 20221206.131426 - SO_RCVBUF limited by kernel to 212992 (208.00 K)
2022-12-06 14:14:32 mars - INFO   - 20221206.131426 - Calling mars on 'fdbprod', local port is 34951
2022-12-06 14:14:32 mars - INFO   - 20221206.131426 - Server task is 146 [ATOS FDB]
2022-12-06 14:14:32 mars - INFO   - 20221206.131427 - Retrieving from FDB [ATOS FDB]
2022-12-06 14:14:32 mars - INFO   - 20221206.131427 - Looking up FDB indexes: 0.004077 second elapsed, 0.003457 second cpu [ATOS FDB]
2022-12-06 14:14:32 mars - INFO   - 20221206.131427 - Calling mars on 'fdbbc', local port is 45993
2022-12-06 14:14:32 mars - INFO   - 20221206.131427 - Server task is 935 [ATOS FDB BC]
2022-12-06 14:14:32 mars - INFO   - 20221206.131427 - Retrieving from FDB [ATOS FDB BC]
2022-12-06 14:14:32 mars - INFO   - 20221206.131427 - Looking up FDB indexes: 0.000586 second elapsed, 0.000579 second cpu [ATOS FDB BC]
2022-12-06 14:14:32 mars - INFO   - 20221206.131427 - Calling mars on 'marsod-core', local port is 46813
2022-12-06 14:14:32 mars - INFO   - 20221206.131427 - Server task is 210 [marsod]
2022-12-06 14:14:32 mars - INFO   - 20221206.131427 - Request cost: 1 field, 4.08561 Mbytes online, nodes: mvr006 [marsod]
2022-12-06 14:14:32 mars - INFO   - 20221206.131427 - The efficiency of your requests in the last 12 hours is 100% [marsod]
2022-12-06 14:14:32 mars - INFO   - 20221206.131427 - Transfering 4284072 bytes
2022-12-06 14:14:32 mars - INFO   - 20221206.131428 - 1 field retrieved from 'marsod'
2022-12-06 14:14:32 mars - INFO   - 20221206.131428 - 1 field has been interpolated
2022-12-06 14:14:32 mars - INFO   - 20221206.131428 - Request time:  wall: 1 sec
2022-12-06 14:14:32 mars - INFO   - 20221206.131428 -   Read from network: 4.09 Mbyte(s) in < 1 sec [21.79 Mbyte/sec]
2022-12-06 14:14:32 mars - INFO   - 20221206.131428 -   Writing to target file: 6.22 Kbyte(s) in < 1 sec [252.11 Kbyte/sec]
2022-12-06 14:14:32 mars - INFO   - 20221206.131428 - Memory used: 59.92 Mbyte(s)
2022-12-06 14:14:32 mars - INFO   - 20221206.131428 - No errors reported
2022-12-06 14:14:32 Process '['nice', 'mars', '/tmp/20221206-1310/64/tmp-_marst1S1si.req']' finished
2022-12-06 14:14:32 Request is complete
2022-12-06 14:14:32 Transfering 6.2207 Kbytes into /Users/mafp/climetlab-cache/mars-retriever-8c1e3cb7da626b7282e036e886231f04cb9edb3ea16a4fa628b3b991a5bcb052.cache.tmp
2022-12-06 14:14:32 From https://stream.ecmwf.int/data/webmars-private-svc-blue-010/data/scratch/20221206-1310/7c/_mars-webmars-private-svc-blue-010-6fe5cac1a363ec1525f54343b6cc9fd8-ivYIUo.grib
2022-12-06 14:14:33 Transfer rate 20.6849 Kbytes/s
2022-12-06 14:14:33 Done

Export the data to a shared directory

This is optional, you could keep working on the data from the cache if you are the only user of the data and you do not mind redownloading it later. Other people should not use your cache: - When using climetlab the cache will eventually fills up and the data may be deleted automatically, - You will need to deal with permissions issues. - It will make it difficult to share the data with other people.

Let us export the data to a shared directory shared-data/temperature-for-analysis

[5]:
# Some housekeeping
!rm -rf shared-data/temperature-for-analysis
!mkdir -p shared-data/temperature-for-analysis
[6]:
# export all data from my cache which is from mars and not older that 1 day
!climetlab export_cache shared-data/temperature-for-analysis --newer 1h --match mars
Copying cache entries matching 'mars' and newer than '2022-12-06 13:14:36' to shared-data/temperature-for-analysis.
100%|██████████████████████████████████████████| 13/13 [00:00<00:00, 145.45it/s]
Copied 13 cache entries to shared-data/temperature-for-analysis.

Create indexes to speed up data access when using it. (Optional)

[7]:
!climetlab index_directory shared-data/temperature-for-analysis
  0%|                                                    | 0/13 [00:00<?, ?it/s]
Parsing shared-data/temperature-for-analysis/mars-retriever-ed2ab4d5cd22ea26a951
Parsing shared-data/temperature-for-analysis/mars-retriever-ed2ab4d5cd22ea26a951
  8%|███▍                                        | 1/13 [00:00<00:01,  7.06it/s]
Parsing shared-data/temperature-for-analysis/mars-retriever-4617cd8c5d7638680756

Parsing shared-data/temperature-for-analysis/mars-retriever-f7438015c79b0b04fd36

Parsing shared-data/temperature-for-analysis/mars-retriever-a151e7fcd829068805a0

Parsing shared-data/temperature-for-analysis/mars-retriever-753548dc22f2ee602d29
 38%|████████████████▉                           | 5/13 [00:00<00:00, 23.06it/s]
Parsing shared-data/temperature-for-analysis/mars-retriever-c149696861938d3c643f

Parsing shared-data/temperature-for-analysis/mars-retriever-16ce872a11c5f3b91f39

Parsing shared-data/temperature-for-analysis/mars-retriever-78609f47b96dc5ae0d89

Parsing shared-data/temperature-for-analysis/mars-retriever-7883dd45cc6f0fa02979
 69%|██████████████████████████████▍             | 9/13 [00:00<00:00, 29.28it/s]
Parsing shared-data/temperature-for-analysis/mars-retriever-8fb146d9165f57f748eb

Parsing shared-data/temperature-for-analysis/mars-retriever-9486ef0e729f0dc27929

Parsing shared-data/temperature-for-analysis/mars-retriever-2f810c33e544b92eec11

Parsing shared-data/temperature-for-analysis/mars-retriever-8c1e3cb7da626b7282e0
100%|███████████████████████████████████████████| 13/13 [00:00<00:00, 29.79it/s]
Building index for path: 100%|████████████████| 36/36 [00:00<00:00, 8880.49it/s]
Indexed 367 fields in 0.4 second.
[8]:
!climetlab availability shared-data/temperature-for-analysis

Using the data

[9]:
DATA = "shared-data/temperature-for-analysis"
[10]:
source = cml.load_source('directory', DATA)
[11]:
source.availability
[11]:

class=od, domain=g, expver=0001, levtype=sfc, md5_grid_section=ce1bd075c48ae7a5bf34f4e47166e942, step=0, stream=oper, time=1200, type=an
   date=[20120101, 20120102, 20120103, 20120104, 20120105, 20120106, 20120107, 20120108, 20120109, 20120110, 20120111, 20120112, 20120113, 20120114, 20120115, 20120116, 20120117, 20120118, 20120119, 20120120, 20120121, 20120122, 20120123, 20120124, 20120125, 20120126, 20120127, 20120128, 20120129, 20120130, 20120131, 20120201, 20120202, 20120203, 20120204, 20120205, 20120206, 20120207, 20120208, 20120209, 20120210, 20120211, 20120212, 20120213, 20120214, 20120215, 20120216, 20120217, 20120218, 20120219, 20120220, 20120221, 20120222, 20120223, 20120224, 20120225, 20120226, 20120227, 20120228, 20120229, 20120301, 20120302, 20120303, 20120304, 20120305, 20120306, 20120307, 20120308, 20120309, 20120310, 20120311, 20120312, 20120313, 20120314, 20120315, 20120316, 20120317, 20120318, 20120319, 20120320, 20120321, 20120322, 20120323, 20120324, 20120325, 20120326, 20120327, 20120328, 20120329, 20120330, 20120331, 20120401, 20120402, 20120403, 20120404, 20120405, 20120406, 20120407, 20120408, 20120409, 20120410, 20120411, 20120412, 20120413, 20120414, 20120415, 20120416, 20120417, 20120418, 20120419, 20120420, 20120421, 20120422, 20120423, 20120424, 20120425, 20120426, 20120427, 20120428, 20120429, 20120430, 20120501, 20120502, 20120503, 20120504, 20120505, 20120506, 20120507, 20120508, 20120509, 20120510, 20120511, 20120512, 20120513, 20120514, 20120515, 20120516, 20120517, 20120518, 20120519, 20120520, 20120521, 20120522, 20120523, 20120524, 20120525, 20120526, 20120527, 20120528, 20120529, 20120530, 20120531, 20120601, 20120602, 20120603, 20120604, 20120605, 20120606, 20120607, 20120608, 20120609, 20120610, 20120611, 20120612, 20120613, 20120614, 20120615, 20120616, 20120617, 20120618, 20120619, 20120620, 20120621, 20120622, 20120623, 20120624, 20120625, 20120626, 20120627, 20120628, 20120629, 20120630, 20120701, 20120702, 20120703, 20120704, 20120705, 20120706, 20120707, 20120708, 20120709, 20120710, 20120711, 20120712, 20120713, 20120714, 20120715, 20120716, 20120717, 20120718, 20120719, 20120720, 20120721, 20120722, 20120723, 20120724, 20120725, 20120726, 20120727, 20120728, 20120729, 20120730, 20120731, 20120801, 20120802, 20120803, 20120804, 20120805, 20120806, 20120807, 20120808, 20120809, 20120810, 20120811, 20120812, 20120813, 20120814, 20120815, 20120816, 20120817, 20120818, 20120819, 20120820, 20120821, 20120822, 20120823, 20120824, 20120825, 20120826, 20120827, 20120828, 20120829, 20120830, 20120831, 20120901, 20120902, 20120903, 20120904, 20120905, 20120906, 20120907, 20120908, 20120909, 20120910, 20120911, 20120912, 20120913, 20120914, 20120915, 20120916, 20120917, 20120918, 20120919, 20120920, 20120921, 20120922, 20120923, 20120924, 20120925, 20120926, 20120927, 20120928, 20120929, 20120930, 20121001, 20121002, 20121003, 20121004, 20121005, 20121006, 20121007, 20121008, 20121009, 20121010, 20121011, 20121012, 20121013, 20121014, 20121015, 20121016, 20121017, 20121018, 20121019, 20121020, 20121021, 20121022, 20121023, 20121024, 20121025, 20121026, 20121027, 20121028, 20121029, 20121030, 20121031, 20121101, 20121102, 20121103, 20121104, 20121105, 20121106, 20121107, 20121108, 20121109, 20121110, 20121111, 20121112, 20121113, 20121114, 20121115, 20121116, 20121117, 20121118, 20121119, 20121120, 20121121, 20121122, 20121123, 20121124, 20121125, 20121126, 20121127, 20121128, 20121129, 20121130, 20121201, 20121202, 20121203, 20121204, 20121205, 20121206, 20121207, 20121208, 20121209, 20121210, 20121211, 20121212, 20121213, 20121214, 20121215, 20121216, 20121217, 20121218, 20121219, 20121220, 20121221, 20121222, 20121223, 20121224, 20121225, 20121226, 20121227, 20121228, 20121229, 20121230, 20121231], param=2t
   date=20121201, param=msl

This is a good time to check the data, is all the data here? Are they missing dates? Parameters?

The data is ready to be used as numpy, tensorflow or xarray object.

[12]:
source.sel(param='msl').to_numpy().mean()
[12]:
101725.47522756307
[13]:
cml.load_source('directory', DATA, param='msl').to_numpy().mean()
[13]:
101725.47522756307
[14]:
temp = source.sel(param='2t').order_by('date')
temp.to_tfdataset()
Metal device set to: Apple M1 Pro

systemMemory: 16.00 GB
maxCacheSize: 5.33 GB

2022-12-06 14:14:54.269537: I tensorflow/core/common_runtime/pluggable_device/pluggable_device_factory.cc:306] Could not identify NUMA node of platform GPU ID 0, defaulting to 0. Your kernel may not have been built with NUMA support.
2022-12-06 14:14:54.269952: I tensorflow/core/common_runtime/pluggable_device/pluggable_device_factory.cc:272] Created TensorFlow device (/job:localhost/replica:0/task:0/device:GPU:0 with 0 MB memory) -> physical PluggableDevice (device: 0, name: METAL, pci bus id: <undefined>)
[14]:
<ZipDataset element_spec=(TensorSpec(shape=<unknown>, dtype=tf.float32, name=None), TensorSpec(shape=<unknown>, dtype=tf.float32, name=None))>
[15]:
temp.to_xarray()
[15]:
<xarray.Dataset>
Dimensions:     (number: 1, time: 366, step: 1, surface: 1, latitude: 31,
                 longitude: 101)
Coordinates:
  * number      (number) int64 0
  * time        (time) datetime64[ns] 2012-01-01T12:00:00 ... 2012-12-31T12:0...
  * step        (step) timedelta64[ns] 00:00:00
  * surface     (surface) float64 0.0
  * latitude    (latitude) float64 50.0 49.0 48.0 47.0 ... 23.0 22.0 21.0 20.0
  * longitude   (longitude) float64 -50.0 -49.0 -48.0 -47.0 ... 48.0 49.0 50.0
    valid_time  (time, step) datetime64[ns] 2012-01-01T12:00:00 ... 2012-12-3...
Data variables:
    t2m         (number, time, step, surface, latitude, longitude) float32 ...
Attributes:
    GRIB_edition:            1
    GRIB_centre:             ecmf
    GRIB_centreDescription:  European Centre for Medium-Range Weather Forecasts
    GRIB_subCentre:          0
    Conventions:             CF-1.7
    institution:             European Centre for Medium-Range Weather Forecasts
    history:                 2022-12-06T14:14 GRIB to CDM+CF via cfgrib-0.9.1...
[16]:
# Note that this is wrong (not implemented yet)
temp.availability
[16]:

class=od, domain=g, expver=0001, levtype=sfc, md5_grid_section=ce1bd075c48ae7a5bf34f4e47166e942, step=0, stream=oper, time=1200, type=an
   date=[20120101, 20120102, 20120103, 20120104, 20120105, 20120106, 20120107, 20120108, 20120109, 20120110, 20120111, 20120112, 20120113, 20120114, 20120115, 20120116, 20120117, 20120118, 20120119, 20120120, 20120121, 20120122, 20120123, 20120124, 20120125, 20120126, 20120127, 20120128, 20120129, 20120130, 20120131, 20120201, 20120202, 20120203, 20120204, 20120205, 20120206, 20120207, 20120208, 20120209, 20120210, 20120211, 20120212, 20120213, 20120214, 20120215, 20120216, 20120217, 20120218, 20120219, 20120220, 20120221, 20120222, 20120223, 20120224, 20120225, 20120226, 20120227, 20120228, 20120229, 20120301, 20120302, 20120303, 20120304, 20120305, 20120306, 20120307, 20120308, 20120309, 20120310, 20120311, 20120312, 20120313, 20120314, 20120315, 20120316, 20120317, 20120318, 20120319, 20120320, 20120321, 20120322, 20120323, 20120324, 20120325, 20120326, 20120327, 20120328, 20120329, 20120330, 20120331, 20120401, 20120402, 20120403, 20120404, 20120405, 20120406, 20120407, 20120408, 20120409, 20120410, 20120411, 20120412, 20120413, 20120414, 20120415, 20120416, 20120417, 20120418, 20120419, 20120420, 20120421, 20120422, 20120423, 20120424, 20120425, 20120426, 20120427, 20120428, 20120429, 20120430, 20120501, 20120502, 20120503, 20120504, 20120505, 20120506, 20120507, 20120508, 20120509, 20120510, 20120511, 20120512, 20120513, 20120514, 20120515, 20120516, 20120517, 20120518, 20120519, 20120520, 20120521, 20120522, 20120523, 20120524, 20120525, 20120526, 20120527, 20120528, 20120529, 20120530, 20120531, 20120601, 20120602, 20120603, 20120604, 20120605, 20120606, 20120607, 20120608, 20120609, 20120610, 20120611, 20120612, 20120613, 20120614, 20120615, 20120616, 20120617, 20120618, 20120619, 20120620, 20120621, 20120622, 20120623, 20120624, 20120625, 20120626, 20120627, 20120628, 20120629, 20120630, 20120701, 20120702, 20120703, 20120704, 20120705, 20120706, 20120707, 20120708, 20120709, 20120710, 20120711, 20120712, 20120713, 20120714, 20120715, 20120716, 20120717, 20120718, 20120719, 20120720, 20120721, 20120722, 20120723, 20120724, 20120725, 20120726, 20120727, 20120728, 20120729, 20120730, 20120731, 20120801, 20120802, 20120803, 20120804, 20120805, 20120806, 20120807, 20120808, 20120809, 20120810, 20120811, 20120812, 20120813, 20120814, 20120815, 20120816, 20120817, 20120818, 20120819, 20120820, 20120821, 20120822, 20120823, 20120824, 20120825, 20120826, 20120827, 20120828, 20120829, 20120830, 20120831, 20120901, 20120902, 20120903, 20120904, 20120905, 20120906, 20120907, 20120908, 20120909, 20120910, 20120911, 20120912, 20120913, 20120914, 20120915, 20120916, 20120917, 20120918, 20120919, 20120920, 20120921, 20120922, 20120923, 20120924, 20120925, 20120926, 20120927, 20120928, 20120929, 20120930, 20121001, 20121002, 20121003, 20121004, 20121005, 20121006, 20121007, 20121008, 20121009, 20121010, 20121011, 20121012, 20121013, 20121014, 20121015, 20121016, 20121017, 20121018, 20121019, 20121020, 20121021, 20121022, 20121023, 20121024, 20121025, 20121026, 20121027, 20121028, 20121029, 20121030, 20121031, 20121101, 20121102, 20121103, 20121104, 20121105, 20121106, 20121107, 20121108, 20121109, 20121110, 20121111, 20121112, 20121113, 20121114, 20121115, 20121116, 20121117, 20121118, 20121119, 20121120, 20121121, 20121122, 20121123, 20121124, 20121125, 20121126, 20121127, 20121128, 20121129, 20121130, 20121201, 20121202, 20121203, 20121204, 20121205, 20121206, 20121207, 20121208, 20121209, 20121210, 20121211, 20121212, 20121213, 20121214, 20121215, 20121216, 20121217, 20121218, 20121219, 20121220, 20121221, 20121222, 20121223, 20121224, 20121225, 20121226, 20121227, 20121228, 20121229, 20121230, 20121231], param=2t
   date=20121201, param=msl