- developers-list - monetdb.org

Smart top-k querying: sorted access
by Maarten Duren 16 May '13

16 May '13

Hi all, We are two Computer Science Master students at Utrecht University. As part of our study, we are doing an experimentation project involving MonetDB. We would like to enrich MonetDB by implementing some smart techniques to handle top-k queries. So far, we have successfully implemented the Threshold Algorithm [Fagin] in MAL for a given top-k selection SQL query. It already outperforms MonetDB's strategy (a naive strategy) if the dataset is large enough :) The problem we are facing now is that almost all top-k techniques require sorted access on the attributes used in the score/ranking function. And sorting a BAT in the MAL program is the real performance bottleneck in our MAL program right now. We have had no success using indexes for sorted access because of the way MonetDB deals with these. We already thought of creating an extra table for each attribute used and insert every value in sorted order. This is a way to achieve sorted access on that attribute. But, obviously, that is not the way to go. It would be feasible for one given SQL query and given data, but not as a general solution. So the real question boils down to: (if possible) how can we get sorted access to an arbitrary attribute of a SQL table or a BAT without sorting it in MAL / MonetDB? Thanks, Maarten van Duren & Nik Schuiling

1 0

Building RPMs with geospatial module
by Casey Gum 15 May '13

15 May '13

I need to build all of the RPMs for MonetDB. I don't really have a choice in this - building from scratch on the machine it will be deployed on is (contractually) not an option in this case. I can build everything fine. For instance, from source directory: *mkdir build; cd build* *../configure strict=no assert=no debug=no optimize=yes* *make* *make install* *make rpm* On the machine I build on, I can go to mclient and execute something like: *sql>CREATE TABLE forests(id INT,name TEXT,shape MULTIPOLYGON);* *operation successful (20.620ms)* On the machine that I install RPMs on, I get this: * sql>CREATE TABLE forests(id INT,name TEXT,shape MULTIPOLYGON); 22000!type (multipolygon) unknown in: "create table forests(id int,name text,shape multipolygon)" * Anyone know how to get the RPMs to build with geospatial support?? Thanks, Casey

3 5

Re: In SQL functions, how to fetch table field value to a variable and how to execute dynamic statement?
by liyuesen 00108910 15 May '13

15 May '13

Oh, I got it, the first time there is one record, after that because more than one records are inserted, so select into can't not work! Thanks, Jason On Wed, May 15, 2013 at 06:46:29PM +0800, liyuesen 00108910 wrote: > I use select into as follow, but it does not work as I want. Can you help me fix it? > step1 create table: > CREATE TABLE table_test(f1 integer, f2 integer); > > step2 create inner function: > CREATE FUNCTION MY_Test() > RETURNS int > BEGIN > DECLARE num integer; > SET num = 100; > INSERT INTO table_test values(1, 2); > RETURN num; > END; > step3 create outer function: > CREATE FUNCTION MY_Test1() > RETURNS integer > BEGIN > DECLARE num integer; > DECLARE num1 integer; > DECLARE num2 integer; > SET num = MY_Test(); > SELECT * INTO num1, num2 from table_test; > SET num = num1 + num2; > RETURN num; > END; > step4 call outer function: > > sql>select MY_Test1(); > cardinality violation (2>1) > > I get the result, what's wrong with the statements? how many rows are already in your table_test? Niels > > Thanks, Jason > > On Wed, May 15, 2013 at 06:21:26PM +0800, liyuesen 00108910 wrote: > > What about the SELECT INTO or CURSOR in SQL functions? Can them be used? > CURSORs don't exist, ie you should select into a variable. > > Niels > > > > Jason > > On Wed, May 15, 2013 at 05:16:38PM +0800, liyuesen 00108910 wrote: > > > Hi guys: > > > I am using Moentdb 11.15.3 on Redhat linux on Inter CPU. > > > First issue, I try to write a SQL function , contains statements fetching table values into local variable, but the SELECT INTO and CURSOR statements are not supported, how can I do that? > > Select into is supported. Cursor is and will not be supported. > > > Second issue, can I execute dynamic statements in SQL function? If that is the case, can you show me how to do it? > > Dynamic sql also isn't supported and very unlikely to be supported. > > > > Niels > > > > > > Thanks, Jason ****************************************************************************************** This email and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained here in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this email in error, please notify the sender by phone or email immediately and delete it! *****************************************************************************************

2 1

Re: In SQL functions, how to fetch table field value to a variable and how to execute dynamic statement?
by liyuesen 00108910 15 May '13

15 May '13

I use select into as follow, but it does not work as I want. Can you help me fix it? step1 create table: CREATE TABLE table_test(f1 integer, f2 integer); step2 create inner function: CREATE FUNCTION MY_Test() RETURNS int BEGIN DECLARE num integer; SET num = 100; INSERT INTO table_test values(1, 2); RETURN num; END; step3 create outer function: CREATE FUNCTION MY_Test1() RETURNS integer BEGIN DECLARE num integer; DECLARE num1 integer; DECLARE num2 integer; SET num = MY_Test(); SELECT * INTO num1, num2 from table_test; SET num = num1 + num2; RETURN num; END; step4 call outer function: sql>select MY_Test1(); cardinality violation (2>1) I get the result, what's wrong with the statements? Thanks, Jason On Wed, May 15, 2013 at 06:21:26PM +0800, liyuesen 00108910 wrote: > What about the SELECT INTO or CURSOR in SQL functions? Can them be used? CURSORs don't exist, ie you should select into a variable. Niels > > Jason > On Wed, May 15, 2013 at 05:16:38PM +0800, liyuesen 00108910 wrote: > > Hi guys: > > I am using Moentdb 11.15.3 on Redhat linux on Inter CPU. > > First issue, I try to write a SQL function , contains statements fetching table values into local variable, but the SELECT INTO and CURSOR statements are not supported, how can I do that? > Select into is supported. Cursor is and will not be supported. > > Second issue, can I execute dynamic statements in SQL function? If that is the case, can you show me how to do it? > Dynamic sql also isn't supported and very unlikely to be supported. > > Niels > > > > Thanks, Jason > > ****************************************************************************************** > > This email and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained here in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this email in error, please notify the sender by phone or e ma > il > > immediately and delete it! > > ***************************************************************************************** > > _______________________________________________ > > developers-list mailing list > > developers-list(a)monetdb.org > > http://mail.monetdb.org/mailman/listinfo/developers-list > > -- > Niels Nes, Centrum Wiskunde & Informatica (CWI) > Science Park 123, 1098 XG Amsterdam, The Netherlands > room L3.14, phone ++31 20 592-4098 sip:4098@sip.cwi.nl > url: http://www.cwi.nl/~niels e-mail: Niels.Nes(a)cwi.nl > _______________________________________________ > developers-list mailing list > developers-list(a)monetdb.org > http://mail.monetdb.org/mailman/listinfo/developers-list > ****************************************************************************************** This email and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained here in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this email in error, please notify the sender by phone or email immediately and delete it! *****************************************************************************************

2 1

Re: In SQL functions, how to fetch table field value to a variable and how to execute dynamic statement?
by liyuesen 00108910 15 May '13

15 May '13

What about the SELECT INTO or CURSOR in SQL functions? Can them be used? Jason On Wed, May 15, 2013 at 05:16:38PM +0800, liyuesen 00108910 wrote: > Hi guys: > I am using Moentdb 11.15.3 on Redhat linux on Inter CPU. > First issue, I try to write a SQL function , contains statements fetching table values into local variable, but the SELECT INTO and CURSOR statements are not supported, how can I do that? Select into is supported. Cursor is and will not be supported. > Second issue, can I execute dynamic statements in SQL function? If that is the case, can you show me how to do it? Dynamic sql also isn't supported and very unlikely to be supported. Niels > > Thanks, Jason > ****************************************************************************************** > This email and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained here in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this email in error, please notify the sender by phone or ema il > immediately and delete it! > ***************************************************************************************** > _______________________________________________ > developers-list mailing list > developers-list(a)monetdb.org > http://mail.monetdb.org/mailman/listinfo/developers-list -- Niels Nes, Centrum Wiskunde & Informatica (CWI) Science Park 123, 1098 XG Amsterdam, The Netherlands room L3.14, phone ++31 20 592-4098 sip:4098@sip.cwi.nl url: http://www.cwi.nl/~niels e-mail: Niels.Nes(a)cwi.nl _______________________________________________ developers-list mailing list developers-list(a)monetdb.org http://mail.monetdb.org/mailman/listinfo/developers-list ****************************************************************************************** This email and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained here in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this email in error, please notify the sender by phone or email immediately and delete it! *****************************************************************************************

2 1

Re: developers-list Digest, Vol 9, Issue 6
by kelianh 15 May '13

15 May '13

hello, The tables do not have any constrains. And the disk space used only 5%,the total size is 1.2TB. This error relates to the mmap function , when I type 'ulimit -a': I find the virtual memory was set only 20GB by default. So I change it to unlimited. Then I load sf100 again. It works. Thx, keliang 在 2013-5-15，18:00，developers-list-request@monetdb.org 写道： > Send developers-list mailing list submissions to > developers-list(a)monetdb.org > > To subscribe or unsubscribe via the World Wide Web, visit > http://mail.monetdb.org/mailman/listinfo/developers-list > or, via email, send a message with subject or body 'help' to > developers-list-request(a)monetdb.org > > You can reach the person managing the list at > developers-list-owner(a)monetdb.org > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of developers-list digest..." > > > Today's Topics: > > 1. The crash of loading data (??) > 2. Re: The crash of loading data (Sjoerd Mullender) > 3. Re: The crash of loading data (Stefan Manegold) > 4. In SQL functions, how to fetch table field value to a > variable and how to execute dynamic statement? (liyuesen 00108910) > 5. Re: In SQL functions, how to fetch table field value to a > variable and how to execute dynamic statement? (Niels Nes) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Tue, 14 May 2013 20:29:08 +0800 > From: ?? <hskeliang(a)gmail.com> > To: developers-list(a)monetdb.org > Subject: The crash of loading data > Message-ID: > <CAKzNtiqTBDtN+gNHOznZHRH9PrjsXtD7kegGHvOXbGv9jjtLDQ(a)mail.gmail.com> > Content-Type: text/plain; charset="iso-8859-1" > > Hello, > I'm trying to load SF100 data into MonetDB but it crashed. My server: > > 64bit openSUSE 11.3 > mem: 47GB > swap: 1GB > disk: 1.2T > monetDB: 11.15.3 > > I use DBgen to generate my data. > when I'm in a client I execute a script, after a few minutes, the monetDB > was crashed. > > get some error msg like this: HEAPextend failed to extend to XXX for XXXX > > my script file : > COPY records into from nation.tbl using ...; > COPY records into from region.tbl using ...; > COPY records into from customer.tbl using ...; > COPY records into from part.tbl using ...; > COPY records into from ...; > COPY records into from ...; > COPY records into from ...; > > Does anybody know what's reason for this error ? > and how can i overcome this error? > Any help would be most welcome:) > > Thx, > keliang >

1 0

In SQL functions, how to fetch table field value to a variable and how to execute dynamic statement?
by liyuesen 00108910 15 May '13

15 May '13

Hi guys: I am using Moentdb 11.15.3 on Redhat linux on Inter CPU. First issue, I try to write a SQL function , contains statements fetching table values into local variable, but the SELECT INTO and CURSOR statements are not supported, how can I do that? Second issue, can I execute dynamic statements in SQL function? If that is the case, can you show me how to do it? Thanks, Jason ****************************************************************************************** This email and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained here in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this email in error, please notify the sender by phone or email immediately and delete it! *****************************************************************************************

2 1

The crash of loading data
by 柯亮 14 May '13

14 May '13

Hello, I'm trying to load SF100 data into MonetDB but it crashed. My server: 64bit openSUSE 11.3 mem: 47GB swap: 1GB disk: 1.2T monetDB: 11.15.3 I use DBgen to generate my data. when I'm in a client I execute a script, after a few minutes, the monetDB was crashed. get some error msg like this: HEAPextend failed to extend to XXX for XXXX my script file : COPY records into from nation.tbl using ...; COPY records into from region.tbl using ...; COPY records into from customer.tbl using ...; COPY records into from part.tbl using ...; COPY records into from ...; COPY records into from ...; COPY records into from ...; Does anybody know what's reason for this error ? and how can i overcome this error? Any help would be most welcome:) Thx, keliang

3 2

How to Capture Data with Stethoscope / Tomograph
by Stephen P. Morgan 14 May '13

14 May '13

Can you give a quick explanation on how to get stethoscope or tomograph to capture data? The online documentation is a bit sparse. As I understand it, I can start stethoscope with the following command: "stethoscope -d tpch -h localhost +ts algebra.* bat.* group.* sql.* aggr.*" It does seem to start, but it never seems to progress. I see the following line: "-- opened UDP profile stream StephenMorgan:50010 for localhost" But I never get any more output. As apparently suggested, I ran a query in another window, but got no obvious trace events or any other output. I eventually just killed it with ^C, at which point it said, "-- connection with server localhost closed". It didn't seem to leave behind a file. I also tried running tomograph, using "tomograph -d tpch -h localhost" and got a similar startup message. I ran a query in another window, but nothing happened. When I finally interrupted it, it told me to "Run: 'gnuplot tomograph.gpl'". Aha! Success: however, when I tried that command, it complained that it was "Skipping data file with no valid points". Clearly, I'm missing how to capture data. Thanks, Steve Morgan

1 0

When trying to create a MAL function, an error occurs, can you guys tell me what should I do to create a MAL function.
by liyuesen 00108910 12 May '13

12 May '13

By the way, I am using the newest Monetdb source package,version 11.5.3. And the platfrom is Redhat linux on intel CPU. The error message: mal>function test(i:int):str; mal>io.print(i); mal>i:= i*2; mal> b:= bat.new(:int,:int); mal>bat.insert(b,1,i); mal>io.print(b); mal>return test:= "ok"; mal>end test; MAPI = (monetdb) /tmp/.s.monetdb.50000 QUERY = end test; ERROR = !TypeException:BAT.test[3]:'bat.new' undefined in: b:any := bat.new(_5:int, _6:int) !TypeException:BAT.test[4]:'bat.insert' undefined in: _7:any := bat.insert(b:any, _8:int, i:int) Can you help me to fix the error and give me some advice about how to create a MAL function. The other issue, about the binary copy command. Use explain we can get a MAL function like this. Can the append operations be executed parallel by using language.dataflow(). If that is the case, can you show me how to do this? explain copy binary into sys.DETAIL_UFDR_OTHER from ('/srv/monetdb/o/SID.dat','/srv/monetdb/o/PROBEID.dat','/srv/monetdb/o/GROUPID.dat','/srv/monetdb/o/GGSN_ID.dat','/srv/monetdb/o/SGSN_ID.dat','/srv/monetdb/o/SESSION_INDICATOR.dat','/srv/monetdb/o/BEGIN_TIME.dat','/srv/monetdb/o/BEGIN_TIME_MSEL.dat','/srv/monetdb/o/END_TIME.dat','/srv/monetdb/o/END_TIME_MSEL.dat','/srv/monetdb/o/PROT_CATEGORY.dat','/srv/monetdb/o/PROT_TYPE.dat','/srv/mone tdb/o/L7_CARRIER_PROT.dat','/srv/monetdb/o/MSISDN.dat','/srv/monetdb/o/IMSI.dat','/srv/monetdb/o/IMEI.dat','/srv/monetdb/o/ENCRYPT_VERSION.dat','/srv/monetdb/o/ROAMING_TYPE.dat','/srv/monetdb/o/ROAM_DIRECTION.dat','/srv/monetdb/o/MS_IP.dat','/srv/monetdb/o/SERVER_IP.dat','/srv/monetdb/o/MS_PORT.dat','/srv/monetdb/o/SERVER_PORT.dat','/srv/monetdb/o/APN.dat','/srv/monetdb/o/SGSN_SIG_IP.dat','/srv/monetdb/o/GGSN_SIG_IP.dat','/srv/monetdb/o/SGSN _USER_IP.dat','/srv/monetdb/o/GGSN_USER_IP.dat','/srv/monetdb/o/MCC.dat','/srv/monetdb/o/MNC.dat','/srv/monetdb/o/RAT.dat','/srv/monetdb/o/LAC.dat','/srv/monetdb/o/RAC.dat','/srv/monetdb/o/SAC.dat','/srv/monetdb/o/CI.dat','/srv/monetdb/o/L4_TYPE.dat','/srv/monetdb/o/L4_UL_THROUGHPUT.dat','/srv/monetdb/o/L4_DW_THROUGHPUT.dat','/srv/monetdb/o/L4_UL_GOODPUT.dat','/srv/monetdb/o/L4_DW_GOODPUT.dat','/srv/monetdb/o/NETWORK_UL_TRAFFIC.dat','/srv/mo netdb/o/NETWORK_DL_TRAFFIC.dat','/srv/monetdb/o/L4_UL_PACKETS.dat','/srv/monetdb/o/L4_DW_PACKETS.dat','/srv/monetdb/o/TCP_CONN_STATES.dat','/srv/monetdb/o/TCP_CONN_TIMES.dat','/srv/monetdb/o/TCP_CONN_2_FAILED_TIMES.dat','/srv/monetdb/o/TCP_CONN_3_FAILED_TIMES.dat','/srv/monetdb/o/FLAG.dat','/srv/monetdb/o/FLOW_SAMPLE_RATIO.dat','/srv/monetdb/o/TAC.dat','/srv/monetdb/o/ECI.dat','/srv/monetdb/o/TCP_SYN_TIME.dat','/srv/monetdb/o/TCP_SYN_TIME_MS EL.dat','/srv/monetdb/o/TCP_RTT_STEP1.dat','/srv/monetdb/o/TCP_UL_RETRANS_WITHPL.dat','/srv/monetdb/o/TCP_DW_RETRANS_WITHPL.dat','/srv/monetdb/o/TCP_UL_RETRANS_WITHOUTPL.dat','/srv/monetdb/o/TCP_DW_RETRANS_WITHOUTPL.dat','/srv/monetdb/o/TCP_UL_PACKAGES_WITHPL.dat','/srv/monetdb/o/TCP_DW_PACKAGES_WITHPL.dat','/srv/monetdb/o/TCP_UL_PACKAGES_WITHOUTPL.dat','/srv/monetdb/o/TCP_DW_PACKAGES_WITHOUTPL.dat','/srv/monetdb/o/UPPERLAYER_IP_UL_PACKETS.d at','/srv/monetdb/o/UPPERLAYER_IP_DL_PACKETS.dat','/srv/monetdb/o/DOWNLAYER_IP_UL_PACKETS.dat','/srv/monetdb/o/DOWNLAYER_IP_DL_PACKETS.dat','/srv/monetdb/o/UPPERLAYER_IP_UL_FRAGMENTS.dat','/srv/monetdb/o/UPPERLAYER_IP_DL_FRAGMENTS.dat','/srv/monetdb/o/DOWNLAYER_IP_UL_FRAGMENTS.dat','/srv/monetdb/o/DOWNLAYER_IP_DL_FRAGMENTS.dat','/srv/monetdb/o/SERVICE_DALAY_MSEC.dat','/srv/monetdb/o/VALID_TRANS_DURATION.dat','/srv/monetdb/o/AIR_PORT_DURATION .dat','/srv/monetdb/o/RADIO_CONN_TIMES.dat','/srv/monetdb/o/TCP_FST_SYN_DIRECTION.dat','/srv/monetdb/o/RAN_NE_ID.dat','/srv/monetdb/o/RAN_NE_USER_IP.dat','/srv/monetdb/o/TCP_STATES.dat','/srv/monetdb/o/TCP_RTT.dat','/srv/monetdb/o/TCP_UL_OUTOFSEQU.dat','/srv/monetdb/o/TCP_DW_OUTOFSEQU.dat','/srv/monetdb/o/TCP_WIN_SIZE.dat','/srv/monetdb/o/TCP_MSS.dat','/srv/monetdb/o/TRANS_TYPE.dat','/srv/monetdb/o/GET_NUM.dat','/srv/monetdb/o/GET_SUCCEED_NU M.dat','/srv/monetdb/o/GET_RETRANS_NUM.dat','/srv/monetdb/o/GET_TIMEOUT_NUM.dat','/srv/monetdb/o/POST_NUM.dat','/srv/monetdb/o/POST_SUCCEED_NUM.dat','/srv/monetdb/o/POST_RETRANS_NUM.dat','/srv/monetdb/o/POST_TO_NUM.dat','/srv/monetdb/o/SERVICE_SUCCEED_FLAG.dat','/srv/monetdb/o/INTERFACEID.dat','/srv/monetdb/o/HOMEMCC.dat','/srv/monetdb/o/HOMEMNC.dat','/srv/monetdb/o/HOMEPROVINCE.dat','/srv/monetdb/o/HOMECITY.dat','/srv/monetdb/o/HOST.dat','/ srv/monetdb/o/SERVICE_ID.dat','/srv/monetdb/o/CHARGING_CLASS.dat','/srv/monetdb/o/CHARGE_FLAG.dat','/srv/monetdb/o/Prepaid_Flag.dat'); +-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | mal | +=============================================================================================================================================================================================================+ | function user.s1_1{autoCommit=true}():void; | | X_2 := sql.mvc(); | | (X_3:bat[:oid,:lng] ,X_4:bat[:oid,:lng] ,X_5:bat[:oid,:int] ,X_6:bat[:oid,:lng] ,X_7:bat[:oid,:lng] ,X_8:bat[:oid,:bte] ,X_9:bat[:oid,:lng] ,X_10:bat[:oid,:sht] ,X_11:bat[:oid,:lng] ,X_12:bat[:oid,:s | : ht] ,X_13:bat[:oid,:int] ,X_14:bat[:oid,:int] ,X_15:bat[:oid,:sht] ,X_16:bat[:oid,:str] ,X_17:bat[:oid,:str] ,X_18:bat[:oid,:str] ,X_19:bat[:oid,:int] ,X_20:bat[:oid,:bte] ,X_21:bat[:oid,:bte] ,X_22:bat[ : : :oid,:str] ,X_23:bat[:oid,:str] ,X_24:bat[:oid,:int] ,X_25:bat[:oid,:int] ,X_26:bat[:oid,:str] ,X_27:bat[:oid,:str] ,X_28:bat[:oid,:str] ,X_29:bat[:oid,:str] ,X_30:bat[:oid,:str] ,X_31:bat[:oid,:str] ,X_ : : 32:bat[:oid,:str] ,X_33:bat[:oid,:bte] ,X_34:bat[:oid,:str] ,X_35:bat[:oid,:str] ,X_36:bat[:oid,:str] ,X_37:bat[:oid,:str] ,X_38:bat[:oid,:bte] ,X_39:bat[:oid,:lng] ,X_40:bat[:oid,:lng] ,X_41:bat[:oid,:l : : ng] ,X_42:bat[:oid,:lng] ,X_43:bat[:oid,:lng] ,X_44:bat[:oid,:lng] ,X_45:bat[:oid,:lng] ,X_46:bat[:oid,:lng] ,X_47:bat[:oid,:bte] ,X_48:bat[:oid,:int] ,X_49:bat[:oid,:int] ,X_50:bat[:oid,:int] ,X_51:bat[ : : :oid,:sht] ,X_52:bat[:oid,:int] ,X_53:bat[:oid,:str] ,X_54:bat[:oid,:str] ,X_55:bat[:oid,:int] ,X_56:bat[:oid,:sht] ,X_57:bat[:oid,:lng] ,X_58:bat[:oid,:lng] ,X_59:bat[:oid,:lng] ,X_60:bat[:oid,:lng] ,X_ : : 61:bat[:oid,:lng] ,X_62:bat[:oid,:lng] ,X_63:bat[:oid,:lng] ,X_64:bat[:oid,:lng] ,X_65:bat[:oid,:lng] ,X_66:bat[:oid,:lng] ,X_67:bat[:oid,:lng] ,X_68:bat[:oid,:lng] ,X_69:bat[:oid,:lng] ,X_70:bat[:oid,:l : : ng] ,X_71:bat[:oid,:lng] ,X_72:bat[:oid,:lng] ,X_73:bat[:oid,:lng] ,X_74:bat[:oid,:lng] ,X_75:bat[:oid,:lng] ,X_76:bat[:oid,:lng] ,X_77:bat[:oid,:lng] ,X_78:bat[:oid,:bte] ,X_79:bat[:oid,:lng] ,X_80:bat[ : : :oid,:str] ,X_81:bat[:oid,:bte] ,X_82:bat[:oid,:lng] ,X_83:bat[:oid,:lng] ,X_84:bat[:oid,:lng] ,X_85:bat[:oid,:int] ,X_86:bat[:oid,:int] ,X_87:bat[:oid,:int] ,X_88:bat[:oid,:int] ,X_89:bat[:oid,:int] ,X_ : : 90:bat[:oid,:int] ,X_91:bat[:oid,:int] ,X_92:bat[:oid,:int] ,X_93:bat[:oid,:int] ,X_94:bat[:oid,:int] ,X_95:bat[:oid,:int] ,X_96:bat[:oid,:bte] ,X_97:bat[:oid,:bte] ,X_98:bat[:oid,:str] ,X_99:bat[:oid,:s : : tr] ,X_100:bat[:oid,:lng] ,X_101:bat[:oid,:lng] ,X_102:bat[:oid,:str] ,X_103:bat[:oid,:lng] ,X_104:bat[:oid,:lng] ,X_105:bat[:oid,:bte] ,X_106:bat[:oid,:bte] ) := sql.importTable("sys":str,"detail_ufdr_o : : ther":str,"/srv/monetdb/o/SID.dat":str,"/srv/monetdb/o/PROBEID.dat":str,"/srv/monetdb/o/GROUPID.dat":str,"/srv/monetdb/o/GGSN_ID.dat":str,"/srv/monetdb/o/SGSN_ID.dat":str,"/srv/monetdb/o/SESSION_INDICATO : : R.dat":str,"/srv/monetdb/o/BEGIN_TIME.dat":str,"/srv/monetdb/o/BEGIN_TIME_MSEL.dat":str,"/srv/monetdb/o/END_TIME.dat":str,"/srv/monetdb/o/END_TIME_MSEL.dat":str,"/srv/monetdb/o/PROT_CATEGORY.dat":str,"/s : : rv/monetdb/o/PROT_TYPE.dat":str,"/srv/monetdb/o/L7_CARRIER_PROT.dat":str,"/srv/monetdb/o/MSISDN.dat":str,"/srv/monetdb/o/IMSI.dat":str,"/srv/monetdb/o/IMEI.dat":str,"/srv/monetdb/o/ENCRYPT_VERSION.dat":s : : tr,"/srv/monetdb/o/ROAMING_TYPE.dat":str,"/srv/monetdb/o/ROAM_DIRECTION.dat":str,"/srv/monetdb/o/MS_IP.dat":str,"/srv/monetdb/o/SERVER_IP.dat":str,"/srv/monetdb/o/MS_PORT.dat":str,"/srv/monetdb/o/SERVER_ : : PORT.dat":str,"/srv/monetdb/o/APN.dat":str,"/srv/monetdb/o/SGSN_SIG_IP.dat":str,"/srv/monetdb/o/GGSN_SIG_IP.dat":str,"/srv/monetdb/o/SGSN_USER_IP.dat":str,"/srv/monetdb/o/GGSN_USER_IP.dat":str,"/srv/mone : : tdb/o/MCC.dat":str,"/srv/monetdb/o/MNC.dat":str,"/srv/monetdb/o/RAT.dat":str,"/srv/monetdb/o/LAC.dat":str,"/srv/monetdb/o/RAC.dat":str,"/srv/monetdb/o/SAC.dat":str,"/srv/monetdb/o/CI.dat":str,"/srv/monet : : db/o/L4_TYPE.dat":str,"/srv/monetdb/o/L4_UL_THROUGHPUT.dat":str,"/srv/monetdb/o/L4_DW_THROUGHPUT.dat":str,"/srv/monetdb/o/L4_UL_GOODPUT.dat":str,"/srv/monetdb/o/L4_DW_GOODPUT.dat":str,"/srv/monetdb/o/NET : : WORK_UL_TRAFFIC.dat":str,"/srv/monetdb/o/NETWORK_DL_TRAFFIC.dat":str,"/srv/monetdb/o/L4_UL_PACKETS.dat":str,"/srv/monetdb/o/L4_DW_PACKETS.dat":str,"/srv/monetdb/o/TCP_CONN_STATES.dat":str,"/srv/monetdb/o : : /TCP_CONN_TIMES.dat":str,"/srv/monetdb/o/TCP_CONN_2_FAILED_TIMES.dat":str,"/srv/monetdb/o/TCP_CONN_3_FAILED_TIMES.dat":str,"/srv/monetdb/o/FLAG.dat":str,"/srv/monetdb/o/FLOW_SAMPLE_RATIO.dat":str,"/srv/m : : onetdb/o/TAC.dat":str,"/srv/monetdb/o/ECI.dat":str,"/srv/monetdb/o/TCP_SYN_TIME.dat":str,"/srv/monetdb/o/TCP_SYN_TIME_MSEL.dat":str,"/srv/monetdb/o/TCP_RTT_STEP1.dat":str,"/srv/monetdb/o/TCP_UL_RETRANS_W : : ITHPL.dat":str,"/srv/monetdb/o/TCP_DW_RETRANS_WITHPL.dat":str,"/srv/monetdb/o/TCP_UL_RETRANS_WITHOUTPL.dat":str,"/srv/monetdb/o/TCP_DW_RETRANS_WITHOUTPL.dat":str,"/srv/monetdb/o/TCP_UL_PACKAGES_WITHPL.da : : t":str,"/srv/monetdb/o/TCP_DW_PACKAGES_WITHPL.dat":str,"/srv/monetdb/o/TCP_UL_PACKAGES_WITHOUTPL.dat":str,"/srv/monetdb/o/TCP_DW_PACKAGES_WITHOUTPL.dat":str,"/srv/monetdb/o/UPPERLAYER_IP_UL_PACKETS.dat": : : str,"/srv/monetdb/o/UPPERLAYER_IP_DL_PACKETS.dat":str,"/srv/monetdb/o/DOWNLAYER_IP_UL_PACKETS.dat":str,"/srv/monetdb/o/DOWNLAYER_IP_DL_PACKETS.dat":str,"/srv/monetdb/o/UPPERLAYER_IP_UL_FRAGMENTS.dat":str : : ,"/srv/monetdb/o/UPPERLAYER_IP_DL_FRAGMENTS.dat":str,"/srv/monetdb/o/DOWNLAYER_IP_UL_FRAGMENTS.dat":str,"/srv/monetdb/o/DOWNLAYER_IP_DL_FRAGMENTS.dat":str,"/srv/monetdb/o/SERVICE_DALAY_MSEC.dat":str,"/sr : : v/monetdb/o/VALID_TRANS_DURATION.dat":str,"/srv/monetdb/o/AIR_PORT_DURATION.dat":str,"/srv/monetdb/o/RADIO_CONN_TIMES.dat":str,"/srv/monetdb/o/TCP_FST_SYN_DIRECTION.dat":str,"/srv/monetdb/o/RAN_NE_ID.dat : : ":str,"/srv/monetdb/o/RAN_NE_USER_IP.dat":str,"/srv/monetdb/o/TCP_STATES.dat":str,"/srv/monetdb/o/TCP_RTT.dat":str,"/srv/monetdb/o/TCP_UL_OUTOFSEQU.dat":str,"/srv/monetdb/o/TCP_DW_OUTOFSEQU.dat":str,"/sr : : v/monetdb/o/TCP_WIN_SIZE.dat":str,"/srv/monetdb/o/TCP_MSS.dat":str,"/srv/monetdb/o/TRANS_TYPE.dat":str,"/srv/monetdb/o/GET_NUM.dat":str,"/srv/monetdb/o/GET_SUCCEED_NUM.dat":str,"/srv/monetdb/o/GET_RETRAN : : S_NUM.dat":str,"/srv/monetdb/o/GET_TIMEOUT_NUM.dat":str,"/srv/monetdb/o/POST_NUM.dat":str,"/srv/monetdb/o/POST_SUCCEED_NUM.dat":str,"/srv/monetdb/o/POST_RETRANS_NUM.dat":str,"/srv/monetdb/o/POST_TO_NUM.d : : at":str,"/srv/monetdb/o/SERVICE_SUCCEED_FLAG.dat":str,"/srv/monetdb/o/INTERFACEID.dat":str,"/srv/monetdb/o/HOMEMCC.dat":str,"/srv/monetdb/o/HOMEMNC.dat":str,"/srv/monetdb/o/HOMEPROVINCE.dat":str,"/srv/mo : : netdb/o/HOMECITY.dat":str,"/srv/monetdb/o/HOST.dat":str,"/srv/monetdb/o/SERVICE_ID.dat":str,"/srv/monetdb/o/CHARGING_CLASS.dat":str,"/srv/monetdb/o/CHARGE_FLAG.dat":str,"/srv/monetdb/o/Prepaid_Flag.dat": : : str); : | X_109 := sql.append(X_2,"sys","detail_ufdr_other","sid",X_3); | | X_112 := sql.append(X_109,"sys","detail_ufdr_other","probeid",X_4); | | X_114 := sql.append(X_112,"sys","detail_ufdr_other","groupid",X_5); | | X_116 := sql.append(X_114,"sys","detail_ufdr_other","ggsn_id",X_6); | | X_118 := sql.append(X_116,"sys","detail_ufdr_other","sgsn_id",X_7); | | X_120 := sql.append(X_118,"sys","detail_ufdr_other","session_indicator",X_8); | | X_123 := sql.append(X_120,"sys","detail_ufdr_other","begin_time",X_9); | | X_126 := sql.append(X_123,"sys","detail_ufdr_other","begin_time_msel",X_10); | | X_128 := sql.append(X_126,"sys","detail_ufdr_other","end_time",X_11); | | X_130 := sql.append(X_128,"sys","detail_ufdr_other","end_time_msel",X_12); | | X_132 := sql.append(X_130,"sys","detail_ufdr_other","prot_category",X_13); | | X_135 := sql.append(X_132,"sys","detail_ufdr_other","prot_type",X_14); | | X_137 := sql.append(X_135,"sys","detail_ufdr_other","l7_carrier_prot",X_15); | | X_140 := sql.append(X_137,"sys","detail_ufdr_other","msisdn",X_16); | | X_142 := sql.append(X_140,"sys","detail_ufdr_other","imsi",X_17); | | X_144 := sql.append(X_142,"sys","detail_ufdr_other","imei",X_18); | | X_146 := sql.append(X_144,"sys","detail_ufdr_other","encrypt_version",X_19); | | X_149 := sql.append(X_146,"sys","detail_ufdr_other","roaming_type",X_20); | | X_151 := sql.append(X_149,"sys","detail_ufdr_other","roam_direction",X_21); | | X_154 := sql.append(X_151,"sys","detail_ufdr_other","ms_ip",X_22); | | X_156 := sql.append(X_154,"sys","detail_ufdr_other","server_ip",X_23); | | X_158 := sql.append(X_156,"sys","detail_ufdr_other","ms_port",X_24); | | X_161 := sql.append(X_158,"sys","detail_ufdr_other","server_port",X_25); | | X_163 := sql.append(X_161,"sys","detail_ufdr_other","apn",X_26); | | X_165 := sql.append(X_163,"sys","detail_ufdr_other","sgsn_sig_ip",X_27); | | X_168 := sql.append(X_165,"sys","detail_ufdr_other","ggsn_sig_ip",X_28); | | X_170 := sql.append(X_168,"sys","detail_ufdr_other","sgsn_user_ip",X_29); | | X_172 := sql.append(X_170,"sys","detail_ufdr_other","ggsn_user_ip",X_30); | | X_175 := sql.append(X_172,"sys","detail_ufdr_other","mcc",X_31); | | X_177 := sql.append(X_175,"sys","detail_ufdr_other","mnc",X_32); | | X_179 := sql.append(X_177,"sys","detail_ufdr_other","rat",X_33); | | X_182 := sql.append(X_179,"sys","detail_ufdr_other","lac",X_34); | | X_184 := sql.append(X_182,"sys","detail_ufdr_other","rac",X_35); | | X_187 := sql.append(X_184,"sys","detail_ufdr_other","sac",X_36); | | X_189 := sql.append(X_187,"sys","detail_ufdr_other","ci",X_37); | | X_191 := sql.append(X_189,"sys","detail_ufdr_other","l4_type",X_38); | | X_193 := sql.append(X_191,"sys","detail_ufdr_other","l4_ul_throughput",X_39); | | X_196 := sql.append(X_193,"sys","detail_ufdr_other","l4_dw_throughput",X_40); | | X_198 := sql.append(X_196,"sys","detail_ufdr_other","l4_ul_goodput",X_41); | | X_201 := sql.append(X_198,"sys","detail_ufdr_other","l4_dw_goodput",X_42); | | X_203 := sql.append(X_201,"sys","detail_ufdr_other","network_ul_traffic",X_43); | | X_205 := sql.append(X_203,"sys","detail_ufdr_other","network_dl_traffic",X_44); | | X_207 := sql.append(X_205,"sys","detail_ufdr_other","l4_ul_packets",X_45); | | X_210 := sql.append(X_207,"sys","detail_ufdr_other","l4_dw_packets",X_46); | | X_213 := sql.append(X_210,"sys","detail_ufdr_other","tcp_conn_states",X_47); | | X_215 := sql.append(X_213,"sys","detail_ufdr_other","tcp_conn_times",X_48); | | X_217 := sql.append(X_215,"sys","detail_ufdr_other","tcp_conn_2_failed_times",X_49); | | X_219 := sql.append(X_217,"sys","detail_ufdr_other","tcp_conn_3_failed_times",X_50); | | X_221 := sql.append(X_219,"sys","detail_ufdr_other","flag",X_51); | | X_224 := sql.append(X_221,"sys","detail_ufdr_other","flow_sample_ratio",X_52); | | X_227 := sql.append(X_224,"sys","detail_ufdr_other","tac",X_53); | | X_229 := sql.append(X_227,"sys","detail_ufdr_other","eci",X_54); | | X_231 := sql.append(X_229,"sys","detail_ufdr_other","tcp_syn_time",X_55); | | X_233 := sql.append(X_231,"sys","detail_ufdr_other","tcp_syn_time_msel",X_56); | | X_235 := sql.append(X_233,"sys","detail_ufdr_other","tcp_rtt_step1",X_57); | | X_239 := sql.append(X_235,"sys","detail_ufdr_other","tcp_ul_retrans_withpl",X_58); | | X_241 := sql.append(X_239,"sys","detail_ufdr_other","tcp_dw_retrans_withpl",X_59); | | X_243 := sql.append(X_241,"sys","detail_ufdr_other","tcp_ul_retrans_withoutpl",X_60); | | X_245 := sql.append(X_243,"sys","detail_ufdr_other","tcp_dw_retrans_withoutpl",X_61); | | X_247 := sql.append(X_245,"sys","detail_ufdr_other","tcp_ul_packages_withpl",X_62); | | X_249 := sql.append(X_247,"sys","detail_ufdr_other","tcp_dw_packages_withpl",X_63); | | X_253 := sql.append(X_249,"sys","detail_ufdr_other","tcp_ul_packages_withoutpl",X_64); | | X_255 := sql.append(X_253,"sys","detail_ufdr_other","tcp_dw_packages_withoutpl",X_65); | | X_257 := sql.append(X_255,"sys","detail_ufdr_other","upperlayer_ip_ul_packets",X_66); | | X_259 := sql.append(X_257,"sys","detail_ufdr_other","upperlayer_ip_dl_packets",X_67); | | X_261 := sql.append(X_259,"sys","detail_ufdr_other","downlayer_ip_ul_packets",X_68); | | X_264 := sql.append(X_261,"sys","detail_ufdr_other","downlayer_ip_dl_packets",X_69); | | X_267 := sql.append(X_264,"sys","detail_ufdr_other","upperlayer_ip_ul_fragments",X_70); | | X_269 := sql.append(X_267,"sys","detail_ufdr_other","upperlayer_ip_dl_fragments",X_71); | | X_271 := sql.append(X_269,"sys","detail_ufdr_other","downlayer_ip_ul_fragments",X_72); | | X_273 := sql.append(X_271,"sys","detail_ufdr_other","downlayer_ip_dl_fragments",X_73); | | X_275 := sql.append(X_273,"sys","detail_ufdr_other","service_dalay_msec",X_74); | | X_278 := sql.append(X_275,"sys","detail_ufdr_other","valid_trans_duration",X_75); | | X_281 := sql.append(X_278,"sys","detail_ufdr_other","air_port_duration",X_76); | | X_283 := sql.append(X_281,"sys","detail_ufdr_other","radio_conn_times",X_77); | | X_285 := sql.append(X_283,"sys","detail_ufdr_other","tcp_fst_syn_direction",X_78); | | X_287 := sql.append(X_285,"sys","detail_ufdr_other","ran_ne_id",X_79); | | X_290 := sql.append(X_287,"sys","detail_ufdr_other","ran_ne_user_ip",X_80); | | X_292 := sql.append(X_290,"sys","detail_ufdr_other","tcp_states",X_81); | | X_295 := sql.append(X_292,"sys","detail_ufdr_other","tcp_rtt",X_82); | | X_297 := sql.append(X_295,"sys","detail_ufdr_other","tcp_ul_outofsequ",X_83); | | X_299 := sql.append(X_297,"sys","detail_ufdr_other","tcp_dw_outofsequ",X_84); | | X_301 := sql.append(X_299,"sys","detail_ufdr_other","tcp_win_size",X_85); | | X_304 := sql.append(X_301,"sys","detail_ufdr_other","tcp_mss",X_86); | | X_306 := sql.append(X_304,"sys","detail_ufdr_other","trans_type",X_87); | | X_309 := sql.append(X_306,"sys","detail_ufdr_other","get_num",X_88); | | X_311 := sql.append(X_309,"sys","detail_ufdr_other","get_succeed_num",X_89); | | X_313 := sql.append(X_311,"sys","detail_ufdr_other","get_retrans_num",X_90); | | X_316 := sql.append(X_313,"sys","detail_ufdr_other","get_timeout_num",X_91); | | X_318 := sql.append(X_316,"sys","detail_ufdr_other","post_num",X_92); | | X_320 := sql.append(X_318,"sys","detail_ufdr_other","post_succeed_num",X_93); | | X_323 := sql.append(X_320,"sys","detail_ufdr_other","post_retrans_num",X_94); | | X_325 := sql.append(X_323,"sys","detail_ufdr_other","post_to_num",X_95); | | X_327 := sql.append(X_325,"sys","detail_ufdr_other","service_succeed_flag",X_96); | | X_330 := sql.append(X_327,"sys","detail_ufdr_other","interfaceid",X_97); | | X_332 := sql.append(X_330,"sys","detail_ufdr_other","homemcc",X_98); | | X_334 := sql.append(X_332,"sys","detail_ufdr_other","homemnc",X_99); | | X_337 := sql.append(X_334,"sys","detail_ufdr_other","homeprovince",X_100); | | X_339 := sql.append(X_337,"sys","detail_ufdr_other","homecity",X_101); | | X_342 := sql.append(X_339,"sys","detail_ufdr_other","host",X_102); | | X_344 := sql.append(X_342,"sys","detail_ufdr_other","service_id",X_103); | | X_346 := sql.append(X_344,"sys","detail_ufdr_other","charging_class",X_104); | | X_348 := sql.append(X_346,"sys":str,"detail_ufdr_other","charge_flag",X_105); | | X_351 := sql.append(X_348,"sys":str,"detail_ufdr_other","prepaid_flag",X_106); | | X_352 := aggr.count(X_106); | | sql.affectedRows(X_351,X_352,""); | | end s1_1; | +-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ ****************************************************************************************** This email and its attachments contain confidential information from HUAWEI, which is intended only for the person or entity whose address is listed above. Any use of the information contained here in any way (including, but not limited to, total or partial disclosure, reproduction, or dissemination) by persons other than the intended recipient(s) is prohibited. If you receive this email in error, please notify the sender by phone or email immediately and delete it! *****************************************************************************************

2 1