Tag: SpotfireAdvanced

Spatial Objects Using TERR

Dunia Giniebra Data Science, Spotfire, TERR 1 Comment

A key part of analytics in the oil and gas industry is evaluating opportunities at different locations. Space is always present when looking for profitable development projects. We usually look at the already in production wells and try to find some spatial trends. To stay competitive, we need to find better ways  to access the  data of different areas and its wells. For instance, we can transform the spatial information to compact objects that store the location and shape of each well and lease. These objects can be feed  to different calculations and analyses as geometries. For Spotfire, it also has some advantages, you can use the feature layers of the map chart. In this case, we can visualize the leases as polygons and wells as lines.

Read More

Dunia Giniebra

Linear Regression, the simplest Machine Learning Model

Dunia Giniebra Reservoir Engineering, Spotfire Leave a comment

Linear Regression models are the simplest linear models available in statistical literature. While the assumptions of linearity and normality seem to restrict the practical use of this model, it is surprisingly successful at capturing basic relationships and predicting in most scenarios. The idea behind the model is to fit a line that mimics the relationship between target variables and a combination of predictors (called independent variables). Multiple regression refers to only one target variable and multiple predictors. These models are popular not only for solving the prediction task but also for working as a model selection tools allowing to find the most important predictors and eliminate redundant variables from the analysis.

Read More

Dunia Giniebra

Merging In House and Public Data in Spotfire

Julie Sebby Spotfire 7 Comments
  • Have you ever wanted/needed to merge data sets where the merge would create unwanted duplicates?
  • Have you ever attempted to merge public and private data and struggled with getting the desired output?
  • Have you ever wanted to know how to identify duplicate records in Spotfire?

Read More

Julie Sebby

Guest Spotfire blogger residing in Whitefish, MT.  Working for SM Energy’s Advanced Analytics and Emerging Technology team!

Spotfire Troubleshooting — Fixing a Bug in Spotfire Logistic Regression Modeling

Julie Sebby Data Science, Spotfire Leave a comment

Two weeks ago, I published a Linear and Logistic Regression template on Exchange.ai that can be found here.  When I built the template, my process was as follows:

  1. Add test and training data sets
  2. Build model on training data set
  3. Insert predicted column based on model in test data set

When following this process for the logistic regression model (a classification model), it inserts two columns of data — ProbPrediction and ClassPrediction.  These two columns give a prediction and a probability.  I noticed that some records contained a value for the ClassPrediction but not the ProbPrediction, which seemed odd.  This happened in records where one or more of my predictor columns were null, in which case, neither column should have been populated.

It turns out that this is a bug that can be fixed with the steps below.

  1. Go to the Tools menu and select TERR Tools
  2. Click the Launch TERR Console button
  3. Type getOption(“repos”)
  4. Type install.packages(“SpotfireStats”)
  5. Type q() to exit the program
  6. Close the program and relaunch

See below for a screen shot of the console.

After I relaunched Spotfire and reran the model, I saw consistent population of the ProbPrediction and ClassPrediction columns.  If you have any questions, feel free to contact me at julie@bigmountainanalytics.com.

Julie Sebby

Guest Spotfire blogger residing in Whitefish, MT.  Working for SM Energy’s Advanced Analytics and Emerging Technology team!

Guest Blog: Creating Average Lines for a Data Set

Lucas Wood Spotfire 5 Comments

Anna Smith is an Engineering Technician at Continental Resources up in Oklahoma. Today she will be sharing her journey creating average lines using TERR.

I had often been asked for average lines on line graphs – seeing the average of a dataset compared to each individual line in that data set. I kept trying to figure it out with just calculated columns and formatting issues, but eventually came to the conclusion that Spotfire just doesn’t give us an easy or clean way to do this. So the idea of using TERR came into play. In my example, we wanted to compare production over time to the average over time for a certain well set – and we want this to be dynamic, i.e., if we change our well set selected, then our calculated average line needs to change. Our TERR code, then, needed to subset each day, calculate an average for that day, and spit out a new value. An important note: the function given at the end of the article that we used requires the input days or months, which means if you have a data set with just dates and production numbers, you need to normalize all those dates back to time zero.

Read More

Lucas Wood

Technical Director at Ruths.ai

http://ruths.ai