We have a requirement to read a load of xml files, run validation on them, transform them into entities and stores them in the database. This was being done using a repository wrapping Entity Framework.
What we have found is that Entity Framework slows the process down to the point where it doesn't process the records quickly enough. We profiled the application and the worst performing method was the SaveChanges on the EF context.
We are thinking of introducing threading as a possible solution.
Has anyone any other ideas of how we can speed up the process?