 |
BorlandTalk.com
Borland discussion newsgroups
|
| View previous topic :: View next topic |
| Author |
Message |
Guest
|
 Posted: Mon Nov 27, 2006 4:19 am Post subject: problem with large size database |
 |
|
Hi all,
I am using a TTable component to create an ASCII table
to save it on the disk. I am using Append/Post. I need to
obtain a very large database, near 4Gb. And when the size is
near 1 Gb, an EOverflow is raised. Is it because the TTable loads
all the table into RAM (because my RAM is near 1Gb?) It is the same
with
the Paradox format.
How to avoid this problem?
Thank you. |
|
| Back to top |
|
 |
Dan
Guest
|
| Posted: Tue Nov 28, 2006 9:45 am Post subject: Re: problem with large size database |
|
|
Your table will be too big for Paradox, since the total maximum size
is 2Gb. I suspect that limit will also apply to and ASCII table
accessed by the BDE.
What is the max file size of your OS? FAT32, for example, has a limit
of 2Gb, so it won't work for a file server or DB server.
Firebird is fast and reliable, and is open source. The theoretical
maximum database size is 7Tb, so your table would be no problem for
FB.
FB is a free download, but you probably will need some middleware to
replace the BDE.
One thing for sure: you should use an insert query instead of the
TTable object. The TTable works by making a copy of the entire table
in memory (RAM + local HD space).
This is just a start. We will have to know more about your program to
offer more specific advice.
hope this helps,
Dan
On 26 Nov 2006 14:19:00 -0800, evgueni.titov (AT) gmail (DOT) com wrote:
| Quote: | Hi all,
I am using a TTable component to create an ASCII table
to save it on the disk. I am using Append/Post. I need to
obtain a very large database, near 4Gb. And when the size is
near 1 Gb, an EOverflow is raised. Is it because the TTable loads
all the table into RAM (because my RAM is near 1Gb?) It is the same
with
the Paradox format.
How to avoid this problem?
Thank you. |
|
|
| Back to top |
|
|
DB-1
Guest
|
| Posted: Tue Nov 28, 2006 9:45 am Post subject: Re: problem with large size database |
|
|
Dan wrote:
| Quote: |
One thing for sure: you should use an insert query instead of the
TTable object. The TTable works by making a copy of the entire table
in memory (RAM + local HD space).
|
I do not think there is much difference in here. Both TTable and TQuery
derive from TSBDataset, and the memory usahe and caching schema is very
much the same in both of these. For instance if you have to do a raw,
non-indexed search from a physical Table, both TQuery and TTable need a
lot of buffering space on the local hard disk.
| Quote: | This is just a start. We will have to know more about your program to
offer more specific advice.
|
Yes, and the first question would be, why you have to use any Database
related Delphi components if you just need to create a huge 4 GB size
textual ASCII file.
Or was the idea to use that kind of text file regularly, as a updateable
database, or what? I would not recommend. If you specifically need some
human readable format data storage, better go and check what the modern,
XML-related tools can offer and do. And abandon the old fashioned and
limited BDE on this area.
The usual File access methods, some semicolon ( as a delimiter etc.
That should do the file creation job without file size limitations,
except those that come from Windows FAT and NTFS File Systems.
DB-1 |
|
| Back to top |
|
|
Guest
|
| Posted: Thu Jan 04, 2007 9:30 am Post subject: Re: problem with large size database |
|
|
posted on borland.public.bde today
The generally recommended 2GB/4GB patch is at www.TheDBCommunity.com;
"Downloads", "Fix for Incorrect BDE...". It should work well on all
OSes,
and is also not Delphi-specific...
- If you have reviewed it - and rejected it - you might let us know.
- If you have not checked it out, and get a chance to do so, you
might
also let us know.
This should help you along... maybee??
On 26 Nov 2006 14:19:00 -0800, evgueni.titov (AT) gmail (DOT) com wrote:
| Quote: | Hi all,
I am using a TTable component to create an ASCII table
to save it on the disk. I am using Append/Post. I need to
obtain a very large database, near 4Gb. And when the size is
near 1 Gb, an EOverflow is raised. Is it because the TTable loads
all the table into RAM (because my RAM is near 1Gb?) It is the same
with
the Paradox format.
How to avoid this problem?
Thank you.
if it hurts.... take a pill! |
|
|
| Back to top |
|
|
|
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
|
|
FAQ
Search
Memberlist
Usergroups
Register
Profile
Log in to check your private messages
Log in
