Dear Meteorological Office,

Good afternoon.

In relation to the following weather station

Kielder Castle. SRC 289 Grid ref NU631935

I have a personal interest in the ongoing weather data from this station. Please can you tell me how I can access this data as it is recorded?

Thank you

Yours faithfully,

Doug Paulley

'Enquiries', Meteorological Office

Dear Doug,

Thank you for your email.

I have forwarded your enquiry on to our FOI team and they will get back to
you as soon as possible.

Kind regards,

Sandra

Weather Desk Advisor
Met Office, FitzRoy Road, Exeter, Devon, EX1 3PB, United Kingdom.
Tel: 0870 900 0100 or +44 (0)1392 88 5680 Fax: 0870 900 5050 Twitter:
@metoffice
Email: [1][Met Office request email] or visit
[2]http://www.metoffice.gov.uk

Your personal details will be stored in our database. The information will
not be passed to any third parties. Please advise us if you do not wish
your details to be stored. The Met Office is a Trading Fund of the
Department for Business, Innovation and Skills and is registered under the
Data Protection Act 1998.

show quoted sections

FOImanager, Meteorological Office

Dear Mr Paulley,

Please accept this as acknowledgement of your enquiry dated 6 April 2013.

Under the requirements of the Freedom of Information Act
2000/Environmental Information Regulations 2004, you will receive our
response within a period of 20 working days from the date it was received
within the Met Office.

You should therefore expect to receive our response by 3 May 2013.

 

Kind regards

FOI Manager

 

Met Office FitzRoy Road Exeter EX1 3PB United Kingdom
Tel: +44 (0)1392 884081 Fax: +44 (0)1392 88 5681 
Email: [1][email address]

[2]http://www.metoffice.gov.uk

 

Confidentiality Notice
This e-mail is intended for the addressee only. Its contents are provided
"in confidence" and may be covered by contractual, legal or other
privilege. If you are not the addressee, you may not use or copy it to any
other person. If you receive this e-mail in error, then please contact the
sender as detailed above.

 

 

From: Claire Gray [mailto:[Met Office request email]]
Sent: 08 April 2013 14:02
To: FOImanager
Subject: FWD: Freedom of Information request - Kielder Castle weather
station near Realtime data

 

show quoted sections

FOImanager, Meteorological Office

1 Attachment

Dear Mr Paulley,

 

Please find attached a letter in response to your recent request

 

Kind regards

FOI Manager

Met Office FitzRoy Road Exeter EX1 3PB United Kingdom
Tel: +44 (0)1392 884081 Fax: +44 (0)1392 88 5681 
Email: [1][email address]

[2]http://www.metoffice.gov.uk

 

Confidentiality Notice
This e-mail is intended for the addressee only. Its contents are provided
"in confidence" and may be covered by contractual, legal or other
privilege. If you are not the addressee, you may not use or copy it to any
other person. If you receive this e-mail in error, then please contact the
sender as detailed above.

 

 

 

show quoted sections

Dear FOImanager,

I was recently in contact with Richard Gilchrist, the Community Support Officer at the Forestry Commission, who has told me that you have been misinformed regarding the Kielder Castle weather station.

The station is operational, having recently been replaced with an automated station already. It is logging data but not currently sending it back, pending the installation of a phone line to it, which should happen shortly. When it is connected, all the existing data will be downloaded such that there isn't a data gap, and all future observations will be sent realtime.

I have found it frustrating dealing with the Met Office in attempts to find recorded weather information for Kielder Forest area, through this query and through others; communications within the Met Office, and between the Met Office and me, have been difficult, at times sporadic and incorrect.

I wonder if you would be prepared to arrange for me to receive weather data from the station? What I would like is two things:

1) firstly, and most important to me, in about five weeks time an archive of the latest two months of data, including daily min and max temperatures, humidity or dew point, and wind speed; or data from which I can derive the above

2) if possible (and perhaps this is something the Met Office will do anyway on its WOW or other section on its website) access to the ongoing data from the station.

This is to improve and localise the forecast I voluntarily produce for the use of visitors and local organisations, especially outdoor sport organisations, including the disability respite outdoor centre I go to. The forecast is at http://www.kielderweather.org.uk/ .

Thank you

Doug Paulley

FOImanager, Meteorological Office

Dear Mr Paulley,

Please accept this as acknowledgement of your enquiry dated 30 April 2013.

I will look into your requests below and respond as soon as possible

Kind regards
FOI Manager
Met Office FitzRoy Road Exeter EX1 3PB United Kingdom
Tel: +44 (0)1392 884081 Fax: +44 (0)1392 88 5681 
Email: [email address]
http://www.metoffice.gov.uk

Confidentiality Notice
This e-mail is intended for the addressee only. Its contents are provided "in confidence" and may be covered by contractual, legal or other privilege. If you are not the addressee, you may not use or copy it to any other person. If you receive this e-mail in error, then please contact the sender as detailed above.

show quoted sections

FOImanager, Meteorological Office

1 Attachment

Dear Mr Paulley,

Please find attached a letter in response to your recent email

Kind regards
FOI Manager

Met Office FitzRoy Road Exeter EX1 3PB United Kingdom
Tel: +44 (0)1392 884081 Fax: +44 (0)1392 88 5681 
Email: [email address]

http://www.metoffice.gov.uk

Confidentiality Notice
This e-mail is intended for the addressee only. Its contents are provided "in confidence" and may be covered by contractual, legal or other privilege. If you are not the addressee, you may not use or copy it to any other person. If you receive this e-mail in error, then please contact the sender as detailed above.

show quoted sections

Dear FOImanager,

You just re-sent your original letter of 15th April, in response to my email pointing out that the information contained in that letter is in fact inaccurate. Did you mean to? Here's where I queried your response: https://www.whatdotheyknow.com/request/k...

Please conduct an internal review. There's been a cock-up; you said there is no data being recorded at the Kielder Castle station whereas there is. You said the automatic station would be put in at some point in the future, whereas it is now. Data is being recorded now but not sent down the phone line to the Met as the Met are awaiting installation of the phone line.

So weather data is being recorded at Kielder Castle, contrary to your assertion otherwise, and it has done so with no break.

Please conduct a review of your handling of my request - and most importantly, supply me with the data!

Yours sincerely,

Doug Paulley

FOImanager, Meteorological Office

1 Attachment

Dear Mr Paulley,

Please accept my apologies, I attached the wrong letter in error. The response which should have been sent yesterday is attached.

I will register your request for an internal review and respond to you as soon as possible following that review.

Kind regards
FOI Manager

Met Office FitzRoy Road Exeter EX1 3PB United Kingdom
Tel: +44 (0)1392 884081 Fax: +44 (0)1392 88 5681 
Email: [email address]

http://www.metoffice.gov.uk

Confidentiality Notice
This e-mail is intended for the addressee only. Its contents are provided "in confidence" and may be covered by contractual, legal or other privilege. If you are not the addressee, you may not use or copy it to any other person. If you receive this e-mail in error, then please contact the sender as detailed above.

show quoted sections

FOImanager, Meteorological Office

1 Attachment

Dear Mr Paulley,

Please find attached a letter in response to your request for an internal review

Kind regards
FOI Manager

Met Office FitzRoy Road Exeter EX1 3PB United Kingdom
Tel: +44 (0)1392 884081 Fax: +44 (0)1392 88 5681 
Email: [email address]

http://www.metoffice.gov.uk

Confidentiality Notice
This e-mail is intended for the addressee only. Its contents are provided "in confidence" and may be covered by contractual, legal or other privilege. If you are not the addressee, you may not use or copy it to any other person. If you receive this e-mail in error, then please contact the sender as detailed above.

show quoted sections

Dear FOImanager,

Thank you very much for this, that is useful.

I wonder if it would be possible to inform me when the phone line is in place and the Met Office starts retrieving the data, and how much has been retrieved from the memory. Then I will potentially buy data one three months or so has accumulated.

I can appreciate the difficulty in communications as the site is very remote, there is no reception on any mobile phone network and physically installing a phone line will also undoubtedly be difficult.

Thank you

Yours sincerely,

Doug Paulley

FOImanager, Meteorological Office

Dear Mr Paulley,

Thank you for your email. I am pleased you found the information in the review useful.

I have asked the appropriate teams to keep me updated on the progress of this site, and I will be in touch as soon as we have some further information about the data.

Kind regards
FOI Manager

Met Office FitzRoy Road Exeter EX1 3PB United Kingdom
Tel: +44 (0)1392 884081 Fax: +44 (0)1392 88 5681 
Email: [email address]

http://www.metoffice.gov.uk

Confidentiality Notice
This e-mail is intended for the addressee only. Its contents are provided "in confidence" and may be covered by contractual, legal or other privilege. If you are not the addressee, you may not use or copy it to any other person. If you receive this e-mail in error, then please contact the sender as detailed above.

show quoted sections

Dear FOImanager,

Please could you provide any available update on the current status of the Kielder Castle meteorological station, and the ETA for the Met Office to start retrieving data from it? (i.e. when the phone line and data connection is in?)

Thank you

Yours sincerely,

Doug Paulley

FOImanager, Meteorological Office

Dear Mr Paulley,

Thank you for your email. Our Telephony Technical Team Leader has discussed this issue with BT, and I can confirm the line plant survey, network routing and exchange work has been completed, however, further work is ongoing and unfortunately I cannot provide a specific date of connection yet. As previously mentioned, I will be in touch as soon as we have information about the availability of data.

Kind regards

Claire Gray
FOI Manager

Met Office FitzRoy Road Exeter EX1 3PB United Kingdom
Tel: +44 (0)1392 884081 Fax: +44 (0)1392 88 5681
Email: [email address]

http://www.metoffice.gov.uk

Confidentiality Notice
This e-mail is intended for the addressee only. Its contents are provided "in confidence" and may be covered by contractual, legal or other privilege. If you are not the addressee, you may not use or copy it to any other person. If you receive this e-mail in error, then please contact the sender as detailed above.

show quoted sections

Dear FOImanager,

Please can you provide any update or projected timescale for connection of the Kielder Castle weather station?

Thank you

Yours sincerely,

Doug Paulley

FOImanager, Meteorological Office

Dear Mr Paulley,

Thank you for your email, I have asked for an update on the progress of this site and will feedback as soon as possible

Kind regards
FOI Manager

Met Office FitzRoy Road Exeter EX1 3PB United Kingdom
Tel: +44 (0)1392 885680 Fax: +44 (0)1392 88 5681 
Email: [email address]

http://www.metoffice.gov.uk

Confidentiality Notice
This e-mail is intended for the addressee only. Its contents are provided "in confidence" and may be covered by contractual, legal or other privilege. If you are not the addressee, you may not use or copy it to any other person. If you receive this e-mail in error, then please contact the sender as detailed above.

show quoted sections

Gray, Claire, Meteorological Office

Dear Mr Paulley,

 

Please accept my apologies for the delay in responding.

 

I have received confirmation that the site is undergoing a trial period,
and the data will be monitored by Quality Management before the station is
declared fully operational. I will provide an update as soon as the trial
period has been completed.

 

Kind regards

FOI Manager

 

Met Office FitzRoy Road Exeter EX1 3PB United Kingdom

Tel: +44 (0)1392 885680 Fax: +44 (0)1392 88 5681 

Email: [email address]

 

http://www.metoffice.gov.uk

 

Confidentiality Notice

This e-mail is intended for the addressee only. Its contents are provided
"in confidence" and may be covered by contractual, legal or other
privilege. If you are not the addressee, you may not use or copy it to any
other person. If you receive this e-mail in error, then please contact the
sender as detailed above.

 

 

 

 

 

 

show quoted sections

Dear Gray, Claire,

Thank you!

If you could, when the site is declared formally operational, could you let me know if the trial data is reliable or not? Then could you tell me how (three months later) I can buy three months worth of data from the site, from the date it was confirmed as reliable, so to speak?

Thank you

Yours sincerely,

Doug Paulley

Dear Gray, Claire,

I wonder please if you could please provide an update as to the trial, the reliability of any data from this station so far since automated and if and when it has been / will be declared operational.

Thank you

Yours sincerely,

Doug Paulley

Gray, Claire, Meteorological Office

Thank you for your email, I am currently out of the office, returning on
Monday 9 September 2013.

If your message concerns legal/contractual matters please contact the
Legal team ([email address]) and one of the team will be happy to
assist. For Freedom of Information requests, please call 0870 900 0100 or
email [email address]

Many thanks

Claire

FOImanager, Meteorological Office

Dear Mr Paulley,

A visit was made to the site to fix the faulty TBR whilst completing the usual routines last week (Tuesday 3rd September) as the distance from the service centre at Glasgow is 133 miles each way. The site will be undergoing the normal data trials and once the rainfall data from the TBR has been deemed acceptable the site will then be declared operational.

Kind regards
FOI Manager

Met Office FitzRoy Road Exeter EX1 3PB United Kingdom
Tel: +44 (0)1392 885680 Fax: +44 (0)1392 88 5681 
Email: [email address]

http://www.metoffice.gov.uk

Confidentiality Notice
This e-mail is intended for the addressee only. Its contents are provided "in confidence" and may be covered by contractual, legal or other privilege. If you are not the addressee, you may not use or copy it to any other person. If you receive this e-mail in error, then please contact the sender as detailed above.

show quoted sections

FOImanager, Meteorological Office

Dear Mr Paulley,

I am pleased to update that the Kielder Castle data has been signed off as being of acceptable quality for the observing network.

I have contacted our sales team who confirm they will be able to provide a quote for three months of data once available.

If you wish to contact our enquiries team around mid December on 0870 900 0100 or email them at [Met Office request email], and an advisor will be pleased to take details from you and transfer you to the relevant person who can provide a quote.

Kind regards
FOI Manager

Met Office FitzRoy Road Exeter EX1 3PB United Kingdom
Tel: +44 (0)1392 885680 Fax: +44 (0)1392 88 5681
Email: [email address]

http://www.metoffice.gov.uk

Confidentiality Notice
This e-mail is intended for the addressee only. Its contents are provided "in confidence" and may be covered by contractual, legal or other privilege. If you are not the addressee, you may not use or copy it to any other person. If you receive this e-mail in error, then please contact the sender as detailed above.

show quoted sections

Dear FOImanager,

Thank you very much for that, very useful information.

It's implicit in your reply, but just to be totally clear and just in case, has there been any useful or reliable data through from the station so far? I take it there hasn't been useful or reliable data during the provisioning and testing phase?

Thank you

Yours sincerely,

Doug Paulley

FOImanager, Meteorological Office

Dear Mr Paulley,

Thank you for your email.

I'm afraid I have not been informed if there is any data available to purchase from the testing phase. I am looking into this and will let you know as soon as possible

Kind regards
FOI Manager

show quoted sections

Dear FOImanager,

Thank you.

Surely if there is any data, it is subject to the EIR and thus must be provided irrespective of whether it is formally on sale - though obviously I don't want data if it's definitely wrong or highly questionable.

Thank you for your help.

Yours sincerely,

Doug Paulley

Dear FOImanager,

Sorry to be a pain, but I was wondering if you are any further forward with ascertaining if there is any usable data from the Kielder Castle station from its commissioning and testing phase?

Thanks

Yours sincerely,

Doug Paulley

FOImanager, Meteorological Office

Dear Mr Paulley,

Thank you for your email. I acknowledge your query and will revert back to you as soon as possible.

Kind regards
FOI Manager
Met Office FitzRoy Road Exeter EX1 3PB United Kingdom
Tel: +44 (0)1392 885680 Fax: +44 (0)1392 88 5681 
Email: [email address]

http://www.metoffice.gov.uk

Confidentiality Notice
This e-mail is intended for the addressee only. Its contents are provided "in confidence" and may be covered by contractual, legal or other privilege. If you are not the addressee, you may not use or copy it to any other person. If you receive this e-mail in error, then please contact the sender as detailed above.

show quoted sections

Dear FOImanager,

I wonder if I could please chase the issue of whether there has been any data from the testing phase of this station.

As you know, under EIR 5(2) the Met Office has up to 20 working days maximum to respond to a request for information.

I asked on 19th September, https://www.whatdotheyknow.com/request/k... ,

"It's implicit in your reply, but just to be totally clear and just in case, has there been any useful or reliable data through from the station so far? I take it there hasn't been useful or reliable data during the provisioning and testing phase?"

It's been more than 20 working days; and you have yet to provide this information, despite being further prompted by me.

Could you please let me know what the situation is?

Thank you

Yours sincerely,

Doug Paulley

FOImanager, Meteorological Office

Dear Mr Paulley,

Thank you for your email. Please accept my apologies for the delay in responding to your question about the test data for Kielder Castle.

I can confirm that there is some reliable data for this site recorded during the test period. Unfortunately the records are not complete as there were issues with the rainfall recordings. I am currently waiting for confirmation on exactly what data we have available, I will chase this for you, and respond as soon as possible.

Kind regards
FOI Manager

Met Office FitzRoy Road Exeter EX1 3PB United Kingdom
Tel: +44 (0)1392 885680 Fax: +44 (0)1392 88 5681 
Email: [email address]

http://www.metoffice.gov.uk

Confidentiality Notice
This e-mail is intended for the addressee only. Its contents are provided "in confidence" and may be covered by contractual, legal or other privilege. If you are not the addressee, you may not use or copy it to any other person. If you receive this e-mail in error, then please contact the sender as detailed above.

show quoted sections

FOImanager, Meteorological Office

1 Attachment

Dear Mr Paulley,

Please accept my apologies for the delay in getting back to you.

I have been in discussion with a number of people at the Met Office on the availability of test data to a member of the public. I am pleased to attach the data collected during the test period 22 July 2013 - 17 September 2013. However, please note not all records are complete (the rainfall data was faulty for a time).

If you wish to purchase a bespoke data report for this site for data after the test period (from 17 September 2013 onwards), please contact our enquiries team on 0870 900 0100 or email them at [Met Office request email], and an advisor will be pleased to help you, and if appropriate, provide you with a quote for accessing the information. As a trading fund we are entitled to impose a market-based charge where the information is provided on a commercial basis and the charge is necessary to ensure such information continues to be collected and published.

I hope this answers your enquiry

Kind regards
FOI Manager

Met Office FitzRoy Road Exeter EX1 3PB United Kingdom
Tel: +44 (0)1392 885680 Fax: +44 (0)1392 88 5681 
Email: [email address]

http://www.metoffice.gov.uk

Confidentiality Notice
This e-mail is intended for the addressee only. Its contents are provided "in confidence" and may be covered by contractual, legal or other privilege. If you are not the addressee, you may not use or copy it to any other person. If you receive this e-mail in error, then please contact the sender as detailed above.

show quoted sections

Dear FOImanager,

Firstly: thank you very much. That data is extremely useful indeed and I appreciate you getting it for me. Thank you.

From what I understand from your response, you have supplied all the reliable data and omitted the unbreakable data? If you could just double confirm this that would be great.

Finally, it would make it a great deal more useful if you could supply a spreadsheet rather than the PDF, as extracting data from the PDF for statistical analysis is non trivial and has the potential to introduce error. As my final request before I buy the more recent data, please could you supply the test data in a spreadsheet? It looks like the PDF was derived from one anyway.

Thank you very much.

Yours sincerely,

Doug Paulley

FOImanager, Meteorological Office

2 Attachments

Dear Mr Paulley,

Please find attached the data in a spreadsheet. It is our normal procedure to provide information as a pdf unless otherwise requested.

Please note the information supplied to you continues to be protected by the Copyright, Designs and Patents Act 1988. You are free to use it for your own purposes, including any non-commercial research you are doing and for the purposes of news reporting. Any other re-use, for example commercial publication, would require the permission of the copyright holder. Most documents supplied by the Met Office will have been produced by government officials and will be Crown Copyright. You can find details on the arrangements for re-using Crown Copyright on the Met Office website at: http://www.metoffice.gov.uk/corporate/le.... Information you receive which is not subject to Crown Copyright continues to be protected by the copyright of the person, or organisation, from which the information originated. You must ensure that you gain their permission before reproducing any third party (non Crown Copyright) information.

The incorrect rainfall data was deleted and therefore has not been included, I have only provided the data that we hold.

Kind regards
FOI Manager

Met Office FitzRoy Road Exeter EX1 3PB United Kingdom
Tel: +44 (0)1392 885680 Fax: +44 (0)1392 88 5681 
Email: [email address]

http://www.metoffice.gov.uk

Confidentiality Notice
This e-mail is intended for the addressee only. Its contents are provided "in confidence" and may be covered by contractual, legal or other privilege. If you are not the addressee, you may not use or copy it to any other person. If you receive this e-mail in error, then please contact the sender as detailed above.

show quoted sections

Dear FOImanager,

Thank you ever so for your considerable help in this matter. It has made a great difference.

Yours sincerely,

Doug Paulley

Dear Claire,

Something most extraordinary is occurring.

The hourly temperature and dew point data from your Kielder Castle site is appearing on the Web, live and free of charge. http://www.weathercast.co.uk/world-weath...

What is going on? Your organisation attempted to charge me £560+VAT for precisely this data for ten weeks, then relented making a special exception following a letter from the MP.

You indicated here https://www.whatdotheyknow.com/request/1... that data from this station will only be available from the sales team. Furthermore the data is not available on your own Weather Observation Website.

Here you state that the information will likely only be collected once a day, and that it will not be available free of charge as an ongoing data feed. https://www.whatdotheyknow.com/request/1...

So how is hourly temperature and dewpoint data appearing live on a third party website? http://www.weathercast.co.uk/world-weath... ? This is directly at odds with what you've told me - and makes somewhat of a mockery of the intervention of the MP.

Please explain by which mechanism this information is being released. Is other data also being released? The rainfall data? How can I access this data directly, rather than screenscraping a third party website?

And what on Earth has gone on?!!

Thank you

Yours sincerely,

Doug Paulley

Gray, Claire, Meteorological Office

Thank you for your email, I am currently out of the office, returning on
Thursday 2 January 2014

If your message concerns legal/contractual matters please contact the
Legal team ([email address]) and one of the team will be happy to
assist. For Freedom of Information requests, please call 0870 900 0100 or
email [email address]

Many thanks

Claire

FOImanager, Meteorological Office

Dear Mr Paulley,

Thank you for your email dated 28 December 2013.

I have asked the relevant areas of the office to look into this situation, and provide the explanations you have requested.

I will revert back as soon as possible.

Kind regards
FOI Manager

Met Office FitzRoy Road Exeter EX1 3PB United Kingdom
Tel: +44 (0)1392 885680 Fax: +44 (0)1392 88 5681 
Email: [email address]

http://www.metoffice.gov.uk

Confidentiality Notice
This e-mail is intended for the addressee only. Its contents are provided "in confidence" and may be covered by contractual, legal or other privilege. If you are not the addressee, you may not use or copy it to any other person. If you receive this e-mail in error, then please contact the sender as detailed above.

show quoted sections

Dear FOImanager,

Thank you.

Can I add to the query please. In your Internal Review at https://www.whatdotheyknow.com/request/1... you say:

"The station has never measured wind speed data and will not be able to provide this going forward."

I can understand this as the location of the site and the surrounding obstacles (cf. castle, trees, hills, valley sides) would make recording of wind data in compliance with meteorological standards impracticable.

Yet Forest Research supplied supposed "wind data" from Kielder Castle in 2010: https://www.whatdotheyknow.com/request/k...

I simply don't understand. Howcome you said wind data has never been recorded at this station, yet Forest Research (who operated this site prior to you taking it over this year) were able to provide wind data?!

Thank you

Yours sincerely,

Doug Paulley

FOImanager, Meteorological Office

1 Attachment

Dear Mr Paulley,

Thank you for recent correspondence following requests for information in
relation to the Kielder Castle station. I have liaised with the
appropriate areas of the Met Office and can provide the following
clarification on the points you raise. Please note this is not a formal
response under FOI or EIR, as your email asked for clarification and
explanations rather than recorded information.

You indicated here
[1]https://www.whatdotheyknow.com/request/1...
that data from this station will only be available from the sales team.
Furthermore the data is not available on your own Weather Observation
Website.

Observations data from Kielder Castle are currently only available as a
commercial service from the Met Office. I can confirm that at present,
live observations from Kielder Castle are not available on the Weather
Observation Website.

 

Here you state that the information will likely only be collected once a
day, and that it will not be available free of charge as an ongoing data
feed.
[2]https://www.whatdotheyknow.com/request/1...

Whilst observations are delivered live from observation stations, we
update the historic archive daily.  There are no current plans to provide
an ongoing data feed from the Kielder Castle station free-of-charge.
However this may change in the future as we are currently undertaking a
complete review of historic/observation data.

 

So how is hourly temperature and dewpoint data appearing live on a third
party website?
[3]http://www.weathercast.co.uk/world-weath...
? This is directly at odds with what you've told me - and makes somewhat
of a mockery of the intervention of the MP.

 

Please explain by which mechanism this information is being released. Is
other data also being released? The rainfall data? How can I access this
data directly, rather than screenscraping a third party website?

The Met Office licences wholesale observations data to a number of
commercial weather providers as well as members of the public.  This data
is delivered to these providers from the observation station in the WMO
approved format (WMO FM-12 or SYNOP code - more details can be found here:
[4]http://www.wmo.int/pages/prog/www/WMOCod...
) without intervention or quality control in bulletins that contain a
range of elements for a number of fixed, predetermined sites.

Once the provider has received these data, they are responsible for any
decoding, storage or onward dissemination to their customers, and they can
choose the price that they charge for these services.  If they wish, they
can provide the data to their customers or the public free-of-charge.  It
would appear that in this case, the provider has chosen to make a rolling
archive of ~5 days available free-of-charge on their website. I am not
able to confirm whether the provider will make other data available. You
may wish to contact them about what data they intend to release, and if it
is directly accessible by other means.

The Met Office charges a handling charge for providing this service
through wholesale, with three bulletins normally required to receive all
the daily timesteps. However, this service does not provide any support to
these customers for the handling or decoding of these data.

Regarding your subsequent email concerning wind data, you asked;

 

Can I add to the query please. In your Internal Review at
[5]https://www.whatdotheyknow.com/request/1...
you say:

 

"The station has never measured wind speed data and will not be able to
provide this going forward."

 

I can understand this as the location of the site and the surrounding
obstacles (cf. castle, trees, hills, valley sides) would make recording of
wind data in compliance with meteorological standards impracticable.

 

Yet Forest Research supplied supposed "wind data" from Kielder Castle in
2010:
[6]https://www.whatdotheyknow.com/request/k...

 

I simply don't understand. How come you said wind data has never been
recorded at this station, yet Forest Research (who operated this site
prior to you taking it over this year) were able to provide wind data?!

           

Please accept my apologies if the statement concerning wind data in a
previous response was partially incorrect. When researching your request
and subsequent review, the observations team confirmed the site has not
had any source capabilities that suggest any wind system has ever been
present at the site. The attached document shows the equipment that has
been recorded at the site, including the manual observed elements from the
observer, and there is no record of wind.

 

However, following your recent email and link to the Forest Research
request, it is evident that some wind data was historically recorded.
Following an investigation I can confirm that wind data was taken by the
observer (a member of Forestry Commission staff) from 1st Jan 1972 to 18
March 2013. This data was taken at the 09.00 observation. The Met Office
have no record of how the reading was taken, however, we can confirm it
was not at a standard height of 10m above the ground using an anemometer.
We can only assume this data was gained from a hand held anemometer for
wind speed and an estimate of the direction. This data was provided to the
Met Office each month in paper format by the Forestry Commission.

 

I note the link you mention shows data for a specific period. Your
original request did not ask for historical wind data, however, if you
would like any historic wind data for this site please let me know and we
will be pleased to consider your request. Please note we cannot confirm
the accuracy of this historic wind data.

 

Since the site became automated, the Met Office has not reported wind data
and will not be able to provide this data going forward, as previously
mentioned. Please accept my apologies for any confusion in this matter,
the information provided was believed to be correct at the time of writing
and was not intended to misinform.

 

I hope the above information meets your requirements.

 

If you have any further requests for recorded information please do not
hesitate to contact me.

 

Kind regards

FOI Manager

 

Met Office FitzRoy Road Exeter EX1 3PB United Kingdom
Tel: +44 (0)1392 885680 Fax: +44 (0)1392 88 5681 
Email: [7][email address]

[8]http://www.metoffice.gov.uk

 

Confidentiality Notice
This e-mail is intended for the addressee only. Its contents are provided
"in confidence" and may be covered by contractual, legal or other
privilege. If you are not the addressee, you may not use or copy it to any
other person. If you receive this e-mail in error, then please contact the
sender as detailed above.

 

References

Visible links
1. https://www.whatdotheyknow.com/request/1...
2. https://www.whatdotheyknow.com/request/1...
3. http://www.weathercast.co.uk/world-weath...
4. http://www.wmo.int/pages/prog/www/WMOCod...
5. https://www.whatdotheyknow.com/request/1...
6. https://www.whatdotheyknow.com/request/k...
7. mailto:[email address]
8. http://www.metoffice.gov.uk/

FOImanager, Meteorological Office

2 Attachments

Dear Mr Paulley,

 

It has come to my attention that the formatting of my previous email has
been removed when published on the what do they know website, making it
difficult to read. Please find attached a pdf version of the response,
which should be clearer.

 

Kind regards

FOI Manager

Met Office FitzRoy Road Exeter EX1 3PB United Kingdom
Tel: +44 (0)1392 885680 Fax: +44 (0)1392 88 5681 
Email: [1][email address]

[2]http://www.metoffice.gov.uk

 

Confidentiality Notice
This e-mail is intended for the addressee only. Its contents are provided
"in confidence" and may be covered by contractual, legal or other
privilege. If you are not the addressee, you may not use or copy it to any
other person. If you receive this e-mail in error, then please contact the
sender as detailed above.

 

 

References

Visible links
1. mailto:[email address]
2. http://www.metoffice.gov.uk/

Dear FOImanager,

Thank you very much for investigating and explaining the situation so clearly.

Thank you for the information about the wind measurements. Whilst I commend the manual observer's enthusiasm, (I don't mean that patronisingly either), I think the data would be at best recording a micro-climate and so of little to no use in tuning my weather model.

You state, "The Met Office licences wholesale observations data to a number of commercial weather providers as well as members of the public." - going on to say it's available in SYNOP or another format. I would love live Kielder Castle weather information in SYNOP bulletins.

Could you advise me how much it would cost to provide to me as a member of the public, for the purposes of tuning and improving my forecast model as outputted at http://www.kielderweather.org.uk? I assume it is prohibitively expensive?

Thank you

Yours sincerely,

Doug Paulley

FOImanager, Meteorological Office

Dear Mr Paulley,

Thank you for your email.

I have asked the Data Wholesaling Manager to provide a quote, and will revert back as soon as possible

Kind regards
FOI Manager

Met Office FitzRoy Road Exeter EX1 3PB United Kingdom
Tel: +44 (0)1392 885680 Fax: +44 (0)1392 88 5681 
Email: [email address]

http://www.metoffice.gov.uk

Confidentiality Notice
This e-mail is intended for the addressee only. Its contents are provided "in confidence" and may be covered by contractual, legal or other privilege. If you are not the addressee, you may not use or copy it to any other person. If you receive this e-mail in error, then please contact the sender as detailed above.

show quoted sections

Dear FOImanager,

Thank you

Yours sincerely,

Doug Paulley

FOImanager, Meteorological Office

Dear Mr Paulley,

Thank you for your email.

Tom McIlwaine, Data Wholesaling Manager (copied into this email) will be in touch to discuss your requirements and provide a quote. Should you wish to contact him, his details are below;

Tom McIlwaine - Data Wholesaling Manager
Met Office FitzRoy Road Exeter Devon EX1 3PB United Kingdom
Tel: +44 (0)1392 884678
Fax: +44 (0)1392 885681
Email: [email address]

Kind regards
FOI Manager

Met Office FitzRoy Road Exeter EX1 3PB United Kingdom
Tel: +44 (0)1392 885680 Fax: +44 (0)1392 88 5681 
Email: [email address]

http://www.metoffice.gov.uk

Confidentiality Notice
This e-mail is intended for the addressee only. Its contents are provided "in confidence" and may be covered by contractual, legal or other privilege. If you are not the addressee, you may not use or copy it to any other person. If you receive this e-mail in error, then please contact the sender as detailed above.

show quoted sections

Dear FOImanager,

The Data Wholesaling Manager has not been in touch. Had he forgotten?

I'm aware that the ICO have been or will be in conversation with yourselves regarding the requirement to publish your schedules and mechanisms for calculating fees for data.

Thanks

Yours sincerely,

Doug Paulley

FOImanager, Meteorological Office

Dear Mr Paulley,

Thank you for your email. Please accept my apologies that you have not been contacted. As this quotation is not being provided under a EIR/FOI request, would it be possible to provide a personal email address for the Data Wholesaling Manager to contact you on? Alternatively, please email him directly to obtain a quotation, his details are below;

Tom McIlwaine - Data Wholesaling Manager Met Office FitzRoy Road Exeter Devon EX1 3PB United Kingdom
Tel: +44 (0)1392 884678
Fax: +44 (0)1392 885681
Email: [email address]

Kind regards
FOI Manager

Met Office FitzRoy Road Exeter EX1 3PB United Kingdom
Tel: +44 (0)1392 885680 Fax: +44 (0)1392 88 5681
Email: [email address]

http://www.metoffice.gov.uk

Confidentiality Notice
This e-mail is intended for the addressee only. Its contents are provided "in confidence" and may be covered by contractual, legal or other privilege. If you are not the addressee, you may not use or copy it to any other person. If you receive this e-mail in error, then please contact the sender as detailed above.

show quoted sections

Dear FOImanager,

Thank you,

My email address is [email address]

Yours sincerely,

Doug Paulley

Looking for an EU Authority?

You can request documents directly from EU Institutions at our sister site AskTheEU.org . Find out more .

AskTheEU.org