Splitting a large XML document using XmlTextReader in ASP.Net

I have done a project recently with a requirement to split a large XML document ( 2 MB file) and split it into small XML files. Obviously we can do this in different ways in ASP.net such as using a XSLT file to split the data or DOM object to separate the nodes.

After much experiment I found using XMLTextReader it is easy to split the large document. DOM approach which I tried was very slow. XMLTextReader wont load the large document to memory so it is faster than using XMLDOM to read the data.

Following is the example of how I tried XMLTextReader in ASP.net to split large XML document object in small pieces.

Code:
 Dim sXMLFile As String = "C:\PathTo\XMLFile.xml"
  ' XML Reader object
  Dim oXTR As New System.Xml.XmlTextReader(sXMLFile)
  Dim sName As String

  While oXTR.Read
            Select (oXTR.NodeType)
                Case System.Xml.XmlNodeType.Element
                    If (oXTR.Name.Equals("student")) Then

                        Dim doc As New System.Xml.XmlDocument()
                        Dim node As XmlNode = doc.ReadNode(oXTR)
                        Dim nodedata As XmlNode
                        doc.AppendChild(node)                       
                        doc.Save("C:\PathTo\resavingdata.xml") � you can pass unique name for file name here
                    End If

            End Select
            ' break
  End While


If you need to output the XML node as a string, you may try something like this:


Code:
   Dim sStringwriter As New System.IO.StringWriter
   Dim doc As New System.Xml.XmlDocument()
   Dim node As XmlNode = doc.ReadNode(oXTR)
   Dim nodedata As XmlNode
   doc.AppendChild(node)
   doc.Save(sStringwriter)
   Response.write(sStringwriter.ToString)



If you need to retrieve a child element from the node, you can try the following


Code:
nodedata = doc.DocumentElement.SelectSingleNode("product/productid")           
   Response.Write(nodedata.Value & "<br />")


Hope this example may help someone out there.

Commentaires

Enregistrer un commentaire

Posts les plus consultés de ce blog

XAJAX with PHP – The future of web development

XAJAX is a class library or framework written purely on PHP that allows you to easily create powerful, Web-based, Ajax applications or plugins. You can download xajax framework from http://sourceforge.net/projects/xajax/ XAJAX is easy to impement. You need to just include XAJAX library, instantiate the xajax object, and register the name of function (or an object or class method) which you want to call from XAJAX framework. xajaxResponse() is an object to return the results of our requests as XML formats. Then call that particular function you want from xajax framework through your HTML or javascript. That's it. XAJAX takes care of most everything else. You just need to write the PHP functions and returning XAJAX XML responses from them, which is made extremely easy by the xajaxResponse class. Code: <?php include './xajax/xajax_core/xajax.inc.php'; $xajax = new xajax(); $rqstAdd =& $xajax->register(XAJAX_FUNCTION, 'ad...
Lire la suite

XAJAX with PHP – The future of web development

XAJAX is a class library or framework written purely on PHP that allows you to easily create powerful, Web-based, Ajax applications or plugins. You can download xajax framework from http://sourceforge.net/projects/xajax/ XAJAX is easy to impement. You need to just include XAJAX library, instantiate the xajax object, and register the name of function (or an object or class method) which you want to call from XAJAX framework. xajaxResponse() is an object to return the results of our requests as XML formats. Then call that particular function you want from xajax framework through your HTML or javascript. That's it. XAJAX takes care of most everything else. You just need to write the PHP functions and returning XAJAX XML responses from them, which is made extremely easy by the xajaxResponse class. Code: <?php include './xajax/xajax_core/xajax.inc.php'; $xajax = new xajax(); $rqstAdd =& $xajax->register(XAJAX_FUNCTION, 'a...
Lire la suite

Database connection pooling in ADO.Net

Imagine a situation that multiple users are connecting the same database through our application. In an application establishing a database connection and logging into it is a time consuming activity. It needs several seconds for every time it establishes a connection. So opening and maintaining a database connection for each user is not an ideal solution. When the number of users increases, and if the system�s memory set is limit, probably it leads to a system crash. This problem can solve through connection pooling. A connection pool is a cache or pool of database connections maintained by the application so that the connections can be reused when the database receives future requests for data. Establishing once and reserving it for future request can essentially improve the overall performance of the application. In connection pooling, after a connection is created, the connection object is placed in the pool. When a simultaneous connection request is made later, ...
Lire la suite