Stack Overflow
Stack Overflow

Questions tagged [data-transform]

Data transformation is the process of converting data from one format or structure into another format or structure. This can range from a simple transformation like transforming a comma-separated list to a line-break-separated list to complex transformations like speech-to-text. Strategies and technologies used can vary widely based on the complexity, volume, format and structure of the data being transformed.

152 questions
0
votes
1 answer

Merging two rows within a dataframe - start and end time

I hope I am doing this right, as it is my first time posting here! I currently have a dataset that looks like this (in total there are 160k…
QuestL
  • 3
  • 2
0
votes
1 answer

Can we call any external REST API inside DBT(Data Build Tool)?

I am working on some analytical work and we need to transform data from one source to another and we are using DBT for transformation purpose. one of the data available to use via only REST API. so my question is can we call external API inside dbt…
MegaBytes
  • 6,155
  • 1
  • 14
  • 32
0
votes
0 answers

Non-linear Data Transformation for Linear Regression

I am new to various types of non-linear data transformation. I am sorry if this question is too basic for experts. I read (https://stattrek.com/regression/linear-transformation.aspx) that there are various types of transformations…
awsuser2021
  • 45
  • 5
0
votes
1 answer

Date Formatting - Dataweave

I two date functions that I'm useing to convert Date/Times into another format. Input_1: 02/01/21 11:00:00 AM Input_2: 02/01/21 3:00:00 PM Desired Output 1: 2021-02-01T11:00:00.000 Desired Output 2: 2021-02-01T15:00:00.000 fun date_time_format(d:…
2fools
  • 111
  • 1
  • 9
0
votes
2 answers

r conditional wide to long with column name pattern

This is a slightly tricky dataset where the columns are laid out like this. ID C.Date T.Date C(Area) T(Area) Level(closet)_1 Venti_1 Level(closet)_2 Venti_2 733 2013.06.18 2013.06.18 65.2 42.1 C6 …
Science11
  • 511
  • 5
  • 17
0
votes
0 answers

Trying to code a categorical variable using ifelse() but I can't code more than one category to a variable

I am trying to code a single column with multiple categorical variables but the condition that I am using comes from multiple columns. Right now, the dataset looks like: Asian Black White Indigenous 1 0 0 0 0 1 0 0 0 0 …
fdauspa
  • 11
  • 1
0
votes
1 answer

How to transform & duplicate an array (or dimension of array) so that each element is in a different index each time

(in c#) I have a huge chunk of game data that I have broken down using a multidimensional array. It is shaped thus: string [,,,] data = new string[18,18,19,2] however, ultimately, that last dimension should be larger. in the last dimensionality,…
BetterLife exe
  • 23
  • 8
0
votes
2 answers

Convert names of vector objects into the tags of the list of vectors with R

I have some vectors, like this: months <- c("january", "february", "march", "october", "december") weekdays <- c("Sunday", "Monday", "Tuesday") seasons <- c("Summer", "Winter", "Fall", "autumn") And I want to create a list like this timeWords_list…
Fidel Alencar
  • 35
  • 3
0
votes
0 answers

Typescript: Discriminating unions without explicitly creating the discriminant?

I want to pass typed data from a database into a generic transformer function. It seems like the best way to accomplish this in Typescript is via a discriminating union. But, this requires a discriminant property. Is there a way to auto-generate the…
aegatlin
  • 406
  • 4
  • 4
0
votes
0 answers

How to upload csv dataset to apache spark and convert that data to streaming data and perform data transformation like filtering

I am a beginner and I watched a few tutorials but not able to understand: How to upload CSV dataset to apache spark and convert that data to streaming data and perform data transformation like filtering. Please if you have any documentations or…
Faizan Shakeel
  • 13
  • 6
0
votes
0 answers

python tag timestamp column as day before yesterday,yesterday and today

Below is my data a b c d e 5641234596 TR 6 2020-11-20 05:20:22 ttttt 5647953896 TR 6 2020-11-21 09:22:23 ttttt 5647953896 TR 6 2020-11-22 05:22:23 ttttt 5647432327 TR 6 2020-11-22 07:45:10…
user3292373
  • 353
  • 2
  • 4
  • 19
0
votes
0 answers

Determining customer preferences with choice based conjoint

I have received a data set about the ingredients of sweets of different brands, as well as information about prices in percent, sugar, and profit in percent. The information on the ingredients are dummy variables, where 0 means that the…
Kitty123
  • 161
  • 8
0
votes
2 answers

R Data transformation: dataframe to matrix filled with 0 and 1

I am looking to transform a long dataformat to a wide one, but the values of the "signatories" column are not exactly the same as the new column names should be. I have a dataframe with bill numbers and the names of their signatories (senators). If…
scarlett rouge
  • 77
  • 5
0
votes
2 answers

What is the best way to itterate over key value pairs nested in an index using javascript?

I am trying to sort sets of associated key value pairs. They look like this: {"word":"a","votes":9326,"userMade":"FALSE","limiter":"FALSE"}, But organized into labeled subsets of preferably a string or perhaps an index if necessary. The data-set is…
Ten Zen
  • 3
  • 4
0
votes
0 answers

Build Pivot table in js with Css Grid

I'm getting from server data that looks like: "data":[ { "due_to_group":null, "period":"Total Period", "group_type":"SummaryGroup", "model_iteration":"SB_ITERATION_15_1673", …
Simcha
  • 2,880
  • 7
  • 25
  • 38
1 2 3
…
10 11