Stack Overflow
Stack Overflow

Questions tagged [batch-processing]

Batch-processing refers to programmatic execution with minimum human interaction.

Batch processing is a general term for frequently-used programs that are executed with minimum human interaction. Batch-process jobs are often scheduled to start up on their own, as resources permit. Historically and practically, this is integral to scripting; thus the well-known batch file.

Batch processing can as easily refer to performing a sequence of actions on a group (batch) of items, whether in software, manufacturing, agriculture, etc.

3632 questions
16
votes
2 answers

How to rename n files with ANT? (Batch Job)

How can I rename 1..n file with ANT? I would like to rename any files with xxxx.default.properties to xxxx.local.properties. Thank you.
Thomas Zuberbuehler
  • 6,224
  • 12
  • 39
  • 68
16
votes
3 answers

C# mongodb driver 2.0 - How to upsert in a bulk operation?

I migrated from 1.9 to 2.2 and reading the documentation I was surprised to discover that is not possible to upsert during a bulk operation anymore, since operations don't allow options. bulkOps.Add(new UpdateOneModel(filter,…
Adrian Lopez
  • 2,081
  • 5
  • 26
  • 44
16
votes
3 answers

What is the max JDBC batch size?

I have a list and that list increasing continuously. I am doing add batch depend on the list size. I forgot to put limit for do executeBatch in specified size. Program is working for hours. I dont want to stop, fix and start again for now. My…
vlyalcin
  • 421
  • 1
  • 4
  • 9
16
votes
5 answers

keep command line window open when running scheduled task executing batch file

I would like to have the console window kept open when running a scheduled task which executes a batch file. If I run it manually meaning execute the batch file the window stays open but through task scheduler it doesn't open but I can see the task…
vbNewbie
  • 3,187
  • 13
  • 61
  • 138
15
votes
5 answers

Batching DB commands in Entity Framework 4.0

My current project requires everyday synchronization with external system. The synchronization is based on complex import file structure which is parsed and processed with extensive business logic. Due to the business logic we decided to make this…
Ladislav Mrnka
  • 349,807
  • 56
  • 643
  • 654
14
votes
1 answer

How to perform tf.image.per_image_standardization on a batch of images in tensorflow

I would like to know how to perform image whitening on a batch of images. According to the documentation in https://www.tensorflow.org/api_docs/python/tf/image/per_image_standardization, it is said that tf.image.per_image_standardization takes as…
I. A
  • 1,938
  • 17
  • 47
14
votes
3 answers

How to delete multiple db entities with Nhibernate?

What is the best practice for this problem? Is there any batching features built-in? Sample code: using (ITransaction transaction = _session.BeginTransaction()) { _session.Delete("FROM myObject o WHERE o.Id = IN(1,2,...99999)"); …
Newbie
  • 6,097
  • 9
  • 53
  • 77
13
votes
2 answers

Training broke with ResourceExausted error

I am new to tensorflow and Machine Learning. Recently I am working on a model. My model is like below, Character level Embedding Vector -> Embedding lookup -> LSTM1 Word level Embedding Vector->Embedding lookup -> LSTM2 [LSTM1+LSTM2] -> single…
Maruf
  • 712
  • 9
  • 36
13
votes
3 answers

Automated httr authentication with twitteR , provide response to interactive prompt in "batch" mode

I am using the R package twitteR to post items to Twitter. I put everything inside of a function and it works fine. However, I would like to run the function without being prompted for a response, and I haven't figured out how to do that. Any…
Jean V. Adams
  • 4,214
  • 2
  • 24
  • 43
13
votes
4 answers

Return multiple items from spring batch ItemProcessor

I'm writing a spring batch job and in one of my step I have the following code for the processor: @Component public class SubscriberProcessor implements ItemProcessor, InitializingBean { @Autowired private…
Fabio
  • 17,633
  • 9
  • 76
  • 110
13
votes
5 answers

How to track progress of multiple simultaneous downloads with AFNetworking?

I am using AFNetworking to download files that my app uses for a sync solution. At certain times, the app downloads a series of files as a batch unit. Following this example, I run the batch like this: NSURL *baseURL =
Jason
  • 14,035
  • 24
  • 87
  • 151
13
votes
2 answers

How do you enable batch inserts in hibernate?

With hibernate, when I attempt to enable batch inserts with 50 I get the following output: [...] cfg.SettingsFactory INFO - JDBC batch updates for versioned data: disabled [...] cfg.SettingsFactory…
rogerdpack
  • 50,731
  • 31
  • 212
  • 332
13
votes
6 answers

How to create a batch file which work for both Program Files and Program Files(x86)?

I have created a batch file which automatically copy a .sql file to the path of installed Jasper server(it could be any software installation directory). This is my batch script-- C:\PROGRA~2\JASPER~1.0\mysql\bin\mysql.exe -u root -proot <…
Sharad
  • 3,374
  • 6
  • 30
  • 58
12
votes
5 answers

Saving 1000+ records to the database at a time

I'm using NHibernate currently. I have a situation where I need to save a bunch of records to the database like this: var relatedTopics = GetRelatedTopics(topic); foreach (var relatedTopic in relatedTopics /* could be anywhere from 10 - 1000+ */) { …
Micah
  • 101,237
  • 81
  • 221
  • 320
12
votes
2 answers

MapReduce/Aggregate operations in SpringBatch

Is it possible to do MapReduce style operations in SpringBatch? I have two steps in my batch job. The first step calculates average. The second step compares each value with average to determine another value. For example, Lets say i have a huge…
Sathish
  • 19,050
  • 22
  • 57
  • 69
1 2
3
…
99 100