FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Postby nageswaragunupudi » Sat Mar 25, 2017 9:20 am

New RecSet class is under development for loading and browsing very large tables. For testing and development, we are using a free cloud server which is obviously slower than local servers or business class servers. In version 17.03 this class is available for use with a limited functionality and will be fully functional in 17.04.

In this post we present a preview of the new class. We have a table `custbig` on the cloud server with one million records. This table is created by inserting "customer.dbf" 2000 times.

This is sample program. ( fwh\samples\maria10.prg )
Code: Select all  Expand view

#include "fivewin.ch"

function Main()

   local oCn, oRs, nRecs

   oCn   := FW_DemoDB()
   ? nRecs := oCn:QueryResult( "SELECT COUNT(*) FROM custbig" ), "Record in table `custbig`"
   oRs   := oCn:RecSet( "custbig", 1000 )
   oRs:nLastRec   := nRecs
   XBROWSER oRs TITLE "`Custbig` table with million records. Ready to browse in " + ;
      Transform( oRs:nReadSecs, "999.9999" ) + " Seconds"  SHOW RECID FASTEDIT
   oCn:Close()

return nil
 


Image

After you download FWH17.03 you can build and test this program by executing
build? maria10
You do not need to have access to any mysql/mariadb server to run this program. This program will connect to the cloud server and display the table.

Even if you do not have FWH17.03 or even if you do not have FWH at all, still you can test this program by downloading zip file from the link below.

http://anserkk.com/gnraomysql/view.php?id=1

Download the zip file, unzip the contents into any blank folder, switch to that folder and run maria10.exe from that folder.

Depending on your own internet speeds, normally you should see the browse of million records within about one second and will be able to gobottom, gotop or use vertical scrollbar for moving to anywhere in the table very fast. You can also modify the data by inline edit or edit dialog and check the performance. We disabled appends in this test program.

Please note that we are getting from a free cloud based server and performance in real life on business -servers / inhouse-servers should be far better.

Whether you are interested or not in FWMARIADB and whatever version of FWH you are using, we encourage you download the EXE and run it and experience it.

We welcome your feedback as well as criticism.
Regards

G. N. Rao.
Hyderabad, India
User avatar
nageswaragunupudi
 
Posts: 10632
Joined: Sun Nov 19, 2006 5:22 am
Location: India

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Postby kok joek hoa » Sat Mar 25, 2017 9:45 am

Dear G. N. Rao.,

just 1.89 second for get all data

Regards,

Kok
kok joek hoa
 
Posts: 117
Joined: Tue Jan 03, 2006 6:18 pm

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Postby dpesic » Sat Mar 25, 2017 11:01 am

Thats realy amazing ! :)

Is there any chance for 'FWPOSTGRESDB' ? :)
dpesic
 
Posts: 11
Joined: Thu Jan 21, 2016 8:26 pm

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Postby nageswaragunupudi » Sat Mar 25, 2017 11:26 am

Is there any chance for 'FWPOSTGRESDB' ? :)

As of now, we do not have any plans.
We would consider if we see many users interested in it.
Regards

G. N. Rao.
Hyderabad, India
User avatar
nageswaragunupudi
 
Posts: 10632
Joined: Sun Nov 19, 2006 5:22 am
Location: India

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Postby miragerr » Sat Mar 25, 2017 12:37 pm

Hello, friends

I'm very interested in PostGreSql, including can collaborate in the development.

I'm standing by.
Jackson Douglas C. Brito
Boa Vista - RR - Brasil
FWH 12.09 Last Build
xHarbour Free
UESTUDIO
SQLRDD
User avatar
miragerr
 
Posts: 140
Joined: Tue Oct 11, 2005 2:36 am
Location: Brasil

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Postby dpesic » Sat Mar 25, 2017 12:55 pm

nageswaragunupudi wrote:
Is there any chance for 'FWPOSTGRESDB' ? :)

As of now, we do not have any plans.
We would consider if we see many users interested in it.


How many is minimum :) ? or ... maybe minimum budget for this ?
dpesic
 
Posts: 11
Joined: Thu Jan 21, 2016 8:26 pm

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Postby nageswaragunupudi » Sat Mar 25, 2017 2:36 pm

I see that (x)Harbour contributions already have postgre library. I have never used though.

May we know what more our members are expecting?
Regards

G. N. Rao.
Hyderabad, India
User avatar
nageswaragunupudi
 
Posts: 10632
Joined: Sun Nov 19, 2006 5:22 am
Location: India

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Postby MGA » Sun Mar 26, 2017 3:47 pm

Parabéns pelo excelente trabalho.

Sr. Nages, todas estas funcionalidades estão disponíveis tanto para MYSQL como para MARIADB?
ubiratanmga@gmail.com

FWH24.04
BCC7.3
HARBOUR3.2
xMate
Pelles´C
TDolphin
MGA
 
Posts: 1252
Joined: Mon Feb 25, 2008 2:54 pm
Location: Brasil/PR/Maringá

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Postby nageswaragunupudi » Sun Mar 26, 2017 3:55 pm

MYSQL como para MARIADB?

Yes.
Both MariaDB server and MySql server behave the same way.
FWH application whether linked with libmariadb.lib or libmysql.lib and run with libmariadb.dll or libmysql.dll work the same way both on mariadb server and mysql server.
Regards

G. N. Rao.
Hyderabad, India
User avatar
nageswaragunupudi
 
Posts: 10632
Joined: Sun Nov 19, 2006 5:22 am
Location: India

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Postby James Bott » Sun Mar 26, 2017 9:42 pm

Wow!

Color me impressed.

James
FWH 18.05/xHarbour 1.2.3/BCC7/Windows 10
User avatar
James Bott
 
Posts: 4840
Joined: Fri Nov 18, 2005 4:52 pm
Location: San Diego, California, USA

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Postby hua » Mon Mar 27, 2017 5:37 am

nageswaragunupudi wrote:I see that (x)Harbour contributions already have postgre library. I have never used though.

May we know what more our members are expecting?


I am interested in Firebird.
FWH 11.08/FWH 19.12
BCC5.82/BCC7.3
xHarbour/Harbour
hua
 
Posts: 1072
Joined: Fri Oct 28, 2005 2:27 am

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Postby Maurizio » Mon Mar 27, 2017 7:32 am

Hello Rao.,

just 0.89 for the first block

Regards,

Maurizio
User avatar
Maurizio
 
Posts: 824
Joined: Mon Oct 10, 2005 1:29 pm


Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Postby dutch » Mon Mar 27, 2017 11:11 am

here is 1.023 seconds, great job.
Regards,
Dutch

FWH 19.01 / xHarbour Simplex 1.2.3 / BCC73 / Pelles C / UEStudio
FWPPC 10.02 / Harbour for PPC (FTDN)
ADS V.9 / MySql / MariaDB
R&R 12 Infinity / Crystal Report XI R2
(Thailand)
User avatar
dutch
 
Posts: 1542
Joined: Fri Oct 07, 2005 5:56 pm
Location: Thailand

Re: FWMARIADB 17.03 Fast Loading/Browsing Very Large Tables

Postby Marcelo Via Giglio » Mon Mar 27, 2017 12:22 pm

PostgreSQL +1
Marcelo Via Giglio
 
Posts: 1064
Joined: Fri Oct 07, 2005 3:33 pm
Location: Cochabamba - Bolivia

Next

Return to FiveWin for Harbour/xHarbour

Who is online

Users browsing this forum: Google [Bot] and 97 guests