Free, Low-Cost, and Open Access Data and Software for Petroleum Exploration and Production
Susan S. Nash, PhD
AAPG Director of Education and Professional Development, Tulsa, OK
Bryan Flynn
Geophysicist
HGS Continuing Education Committee, Houston
Thom Tucker, CPG
HGS Continuing Education Committee, Houston
Imagine a geologist, an engineer, and a landman sitting at their local Starbucks, their tablets and laptops out, discussing whether or not there are economical “stacked pays” in a play in southern Kansas and northern Oklahoma. They are independents, and all of them have had experience with large independents or major oil companies. Each one is nervous about trying to launch a business on their own.
“I thought I had to have access to a $100,000 per year suite of data and software to be in the business,” said Tom, the landman. “But, that is no longer necessary. There are sources of production statistics, well logs, samples, geological reports, and more. And, there are low-cost maps and mapping resources,” said Raylene, the geologist. “And, I can download software used in reservoir modeling, and I can also do basic data mining,” said Marcos, the engineer.
In addition to reports, surveys, databases, maps, software, there are also filings and legal reports which can help in decision-making. The fact that the information is readily available via the internet, and that there are many free cloud-based collaborative tools, makes it more viable than ever to work in teams to quickly put together ideas, evaluate ideas, and make recommendations.
Sources of Free and Low-Cost Data
State Information Sources
Texas Bureau of Economic Geology
Colorado Oil and Gas Conservation Commission
http://cogcc.state.co.us/#/home
Oklahoma Geological Survey: reports, maps, statistics
Oklahoma Corporation Commission: digitized well logs, production, well information
Oklahoma Well Search
http://occoapp1.occeweb.com/occoghlp/W_G27HELP.html
Louisiana Department of Natural Resources (SONRIS – GIS, oil and gas data, well log information)
Pennsylvania Oil and Gas Resources:
http://dcnr.state.pa.us/topogeo/econresource/oilandgas/index.htm
Ohio: Information / Well Log Database
New York: oil, gas, other data: http://www.dec.ny.gov/energy/1524.html
Information on 42,000 deep wells: https://esogis.nysm.nysed.gov/
New Mexico: well logs / data http://ocdimage.emnrd.state.nm.us/imaging/default.aspx
California: http://www.conservation.ca.gov/dog/Online_Data
Wyoming: http://wogcc.state.wy.us/
North Dakota: https://www.dmr.nd.gov/oilgas/
GIS Information Sources and Maps
Intermountain Oil and Gas BMP Project: Great portal page for free / low-cost data and software
http://www.oilandgasbmps.org/resources/gis.php
US Energy Information Administration – Natural Gas
https://www.eia.gov/pub/oil_gas/natural_gas/analysis_publications/maps/maps.htm
Summary Maps: Natural gas in the Lower 48 States and North America
Gas production in conventional fields, Lower 48 States PDF (2.8 MB) JPG (2.5 MB)
Gas production in offshore fields, Lower 48 States PDF (0.4 MB) JPG (1.5 MB)
Shale gas and oil plays, Lower 48 States (4/13/2015) PDF (1.4 MB) JPG (0.6 MB)
Shale gas and oil plays, North America (5/9/2011) PDF (0.4 MB) JPG (1.2 MB)
Major tight gas plays, Lower 48 States PDF (1.6 MB) JPG (2.2 MB)
Coalbed methane fields, Lower 48 States PDF (1.8 MB) JPG (2.7 MB)
Natural Gas Production
https://www.eia.gov/naturalgas/data.cfm#production
Good overview: http://inside.mines.edu/LIB-Maps-GIS
US Energy Mapping System http://www.eia.gov/state/maps.cfm
Geospatial Data Gateway https://gdg.sc.egov.usda.gov/ click the Get Data Button
ESRI online: http://www.arcgis.com/home/group.html?owner=esri&title=ESRI%20Data%20%26%20Maps&content=all
EIA http://www.eia.gov/opendata/widgets.cfm
Data.Gov http://catalog.data.gov/dataset
The National Map http://nationalmap.gov/
EPA Map Viewer http://gis.epa.ie/Envision/
EPA Enviromapper http://map11.epa.gov/myem/efmap/index.html?ve=9,32.77814865112305,-96.79540252685547&pText=Dallas,%20TX
Maps
EIA Base Maps: https://www.eia.gov/state/maps.cfm?src=home-f3
Google Maps for Oil and Gas: https://www.google.com/work/mapsearth/oilgas/
Core Repositories (portal page – somewhat dated): http://www.carbonates.us/cores.htm
State Geological Surveys
Core Information, Repositories, etc.: http://www.carbonates.us/cores.htm
State Geological Surveys: Links / Searchable: http://www.stategeologists.org/surveys.php
Portal to State Geological Surveys: http://www.conservation.ca.gov/cgs/information/other_surveys
Articles / Journals – Open Access
Directory of Open Access Journals: https://doaj.org/
AAPG Search and Discovery: http://www.searchanddiscovery.com/
PetroWiki (SPE): http://petrowiki.org/PetroWiki
Journal of Petroleum Exploration and Production Technologies: https://doaj.org/toc/2190-0566
Oil and Gas Science and Technology: https://doaj.org/toc/1953-8189
Petroleum and Coal: https://doaj.org/toc/1337-7027
Journal of Petroleum Engineering: https://doaj.org/toc/2314-5013
Mexico – Useful Information
Comisión Nacional de Hidrocarburos (CNH) Production: http://www.cnh.gob.mx/5100.aspx
CNH Reserves (by Field): http://www.cnh.gob.mx/5600.aspx#
Pemex: http://www.pemex.com/ri/Publicaciones/Paginas/IndicadoresPetroleros.aspx
Tectonic Map of Mexico (Dr. Ricardo Padilla y Sánchez, UNAM):
Data Mining
In addition, individuals and teams can analyze the information in new and/or innovative ways by using traditional and innovative processing and data mining techniques. Briefly stated, data mining involves statistical analyses to find relationships and patterns that arise from more than one variable, and has turned out to be ideal for all phases of oil and gas exploration, acquisition, and asset development.
The fact that data mining is capable of using machine learning techniques such as unsupervised artificial neural networks, which, through numerous iterations are used for pattern recognition tasks (including seismic signal processing and developing seismic attributes), means that there are numerous opportunities for finding new, potentially very meaningful relationships in data that were previously not considered relevant. It also helps posit potential causal relationships and helps uncover previously unsuspected interdependencies or interrelatedness.
Data Mining Software
Databionic ESOM Tools: A suite of programs that perform data mining tasks such as clustering, visualization, and classification. They use Emergent Self-Organizing Maps as the core tool.
Vowpal Wabbit: Helps users develop fast, scalable, and useful learning algorithms: http://hunch.net/~vw/
OpenNN – Written in C++ and consists of an open source class library which implements neural networks. Most appropriate for advanced users who can program well in C++ and who possess machine learning skills: http://www.artelnics.com/opennn
Orange: Open source data visualization and analysis for novice and expert. It is maintained and developed by the Bioinformatics Laboratory of the Faculty of Computer and Information Science at the University of Ljubljana (Slovenia): http://orange.biolab.si/
Weka: Machine learning software written in Java, and developed by the University of Waikato, New Zealand: http://www.cs.waikato.ac.nz/~ml/weka/
RapidMiner: An integrated environment for machine learning, data mining, predictive analytics, and business analytic: http://www.rapidminer.com
Here is a brief list of the ways that data mining is being used in petroleum exploration and development:
1. Identify zones of preferential enrichment: Data mining is effective in processing and relating calculated total organic carbon (TOC) and oil and gas fingerprinting via isotopes.
2. Target structural patterns / lineaments that relate to productive areas in shales. This is particularly the case in the Marcellus and Niobrara in North America and in the Tarim Basin in China.
3. Relate seismic attributes and seismic stratigraphy, and propose relationships between depositional environments and potential areas for stratigraphic traps.
4. Optimize completions and productions by identifying areas of optimum production, key production metrics, and places to re-frac, (tying microseismic, 3D seismic, oil/gas fingerprinting, pore pressure).
5. Combine geomechanics with TOC and fingerprinting to find patterns that could correspond to migration pathways (big picture) + where to geosteer (close-up view).
6. Combine well log information (thicknesses and structure) with current-day processes for basin modeling with patterns that show the relative likelihood of sand emplacement. The patterns can reflect various depositional models that can incorporate deepwater (turbidites & lobes) or shallow marine deposits.
Tools and Software for Geoscience Interpretation
The following are useful resources that can be obtained at a low cost. In some cases, the software is open-source and free.
Golden Software
Surfer is a full-function contouring and surface modeling package that runs under Microsoft Windows. Surfer is used extensively for terrain modeling, bathymetric modeling, landscape visualization, surface analysis, contour mapping, watershed and 3D surface mapping, gridding, viewshed analysis, volumetrics, and much more.
http://www.goldensoftware.com/products/surfer
Strater displays your raw data as borehole and well logs, maps and cross sections. Strater offers unsurpassed flexibility in design and layout. Strater’s intuitive point-and-click user interface makes it easy to quickly visualize your subsurface data and create professional reports.
http://www.goldensoftware.com/products/strater
MapViewer is an affordable mapping and spatial analysis tool that allows
you to easily produce publication-quality thematic maps. Precisely display your data distribution with the most intuitive functions and features.
http://www.goldensoftware.com/products/mapviewer
Voxler. Create powerful, fast, customized 3D images and 3D models with a fusion of your geologic data, GIS data, well and borehole data, and point cloud data with Voxler 4. Easily import and combine data in a multitude of file formats to create stunning 3D models that visualize the relationships across your data set. This robust, yet user-friendly application gives you the power to display your data in full 3D. http://www.goldensoftware.com/products/voxler
Didger. All the advanced georeferencing, digitizing, coordinate conversion, and mapping features you need in a low-cost, unbelievably versatile program. This is the ultimate geoprocessing and data conversion tool for any map maker, cartographer, geologist, oil and gas professional, or GIS analyst.
http://www.goldensoftware.com/products/didger
Rockware
The main webpage has links to videos for Demos: https://www.rockware.com/
Rockware version 17 comes as an integrated subsurface data and interpretation package with a selection of modules, and is available for purchase or annual rental at four (4) levels, one set of which are FREE! Their overview page for the Petroleum industry, with videos at the bottom, is: https://www.rockware.com/product/overviewSection.php?id=165§ion=40
Some of the modules are:
RockPlot2D Is used to view and edit your 2D images – borehole and sample location point maps, contours and colorfill maps, cross-sections, profiles and other diagrams such as stereonets and piper diagrams. It is one of the Print Windows.
https://www.rockware.com/product/featuresLobby.php?id=165&category=682
RockPlot3D Is used to view 3D images: solids, surfaces, fences, 3D objects, plan view maps, site diagrams and more. https://www.rockware.com/product/featuresLobby.php?id=165&category=374
The ReportWorks window is used to lay out pages for printing and publication- use any of the images that you've created in your final presentation.
https://www.rockware.com/product/featuresLobby.php?id=165&category=373
RockWorks Utilities contains the database, mapping and 3-D functionalities, and modules from Stereo Nets to Geosteering.
https://www.rockware.com/product/featureCategories.php?id=165&parent=362
Logs, Log Sections and Log Maps
Create individual logs or multi-log cross sections and maps in 2D and 3D. Logs can be vertical, inclined, horizontal, or deviated. The versatility of this module is worth reading.
https://www.rockware.com/product/featuresLobby.php?id=165&category=999
Borehole Manager contains a relational database used to store surface and subsurface information. It is used to create striplogs, cross-sections, contour maps, 3D block models and more. https://www.rockware.com/product/featureCategories.php?id=165&parent=984
Encom Discovery appears to be a plug-in module for making maps of any size and scale incorporating all related spatial data objects, filtered and sun-shaded grids, contours, graphics overlays, geo-located raster images, structural symbols, legends, graphs, tables, scale bars, and other mapping objects. You would compare it to Didger (above) or Global Mapper.
https://www.rockware.com/product/featuresLobby.php?id=279&category=726
RockWorks contains a free library of Public Land Survey data.
Low cost Seismic Interpretation software
Like it or not, we spend more time on workstations than on outcrops-- we must have some sort of software to do our jobs. That can be a pretty high barrier to entering the consulting market, but it doesn’t have to be.
There are low cost, or even free software packages for your use depending on what you are trying to accomplish. OpendTect (http://www.opendtect.org/) has an open source, free to use, interpretation platform that is fairly user friendly. It was the tools for most prospecting applications, as well as modules for expandable capabilities. They also have a public domain data sets for you to practice with, or use as examples to show your skills.
Both Crewes (http://www.crewes.org/ResearchLinks/FreeSoftware/) and Seismic Unix (http://www.cwp.mines.edu/cwpcodes/) provide robust packages of command line modules for seismic data processing. These can be very effective for small scale projects, but may not be efficient enough for commercial projects.
Open Geophysical (http://www.opengeophysical.com/) has a fairly low cost data processing package.
SeiSee (http://www.dmng.ru/en/freeware.html) is invaluable for scanning seismic headers so that you can properly load your seismic data.
KC Petrophysics (http://www.kcpetrophysics.com/) has a free LAS application which is great for reading vintage LAS files and converting them to be used in modern packages. Their Pro software is only $200 and very capable of most petrophysical work.
There are as many other software options. This is by no means an exhaustive list, or an endorsement for any particular vendor.
Think “sharing economy.” One thing that Millennials have figured out is how to monetize their assets while they aren’t in use. Talk to other consultants, they may have commercial licenses tied to workstations that they can sublet to you. The owner of the seismic data may have workstations onsite that you can use.
Be creative with your software vendors. Nearly every vendor has a free license period. It may or may not be allowed to be used commercially during that time but obtaining a trial license may keep you current, or allow you to learn a new software package. When you have a contract in, you may be able to negotiate a short term license arrangement. There are also some vendors who will generously train you on their software while you are finding your next opportunity.
These arrangements are only to be found through building relationships, so remember to not be greedy and pay it forward when you can. If KC Petrophysics software helps you with a job, buy the $200 Pro version. If Seismic Unix is useful in building a wedge model, maybe you can donate to the Colorado School of Mines. Or better yet, when your next contract comes in, maybe there is a recent CSM graduate that would love to learn from your experience.
Free and Low cost software for the Engineer
Free Petroleum Engineering Software: http://petroleumsupport.com/petroleum-software/freepetroleumsoftware/
DOE /NETL Software
BOAST
http://www.netl.doe.gov/research/oil-and-gas/software/simulators#BVHS
EOR
http://www.netl.doe.gov/research/oil-and-gas/software/predictive-models#EORPM
These are very valuable resources. That said, it is important not to over-emphasize the free resources. Although extremely useful to people with limited capital, free software has its drawbacks, and they do not have the user-friendly convenience, power, and robustness of SAS, IHS, DrillingInfo, Petra, Petrel, and other popular packages. This is also true of data sets.
The Authors: