RE24 testing call #1 (2.4.42) LMDB RE0.9 testing call #1 (0.9.16)

[Quanah Gibson-Mount]

Content preview: OpenLDAP 2.4.42 Engineering Fixed liblber address length for
CLDAP (ITS#8158) Fixed libldap dnssrv potential overflow with port number
(ITS#7027,ITS#8195) Fixed slapd cn=config when updating olcAttributeTypes
(ITS#8199) Fixed slapd-mdb to correctly update search candidates for scoped
searches (ITS#8203) Fixed slapo-ppolicy with redundant mod ops on glued trees
(ITS#8184) Build Environment Fixed libdb detection with gcc 5.x (ITS#8056)
[...]

Content analysis details: (-2.0 points, 5.0 required)

pts rule name description
---- ---------------------- --------------------------------------------------
0.0 RCVD_IN_DNSWL_BLOCKED RBL: ADMINISTRATOR NOTICE: The query to DNSWL
was blocked. See
http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block
for more information.
[162.209.122.174 listed in list.dnswl.org]
0.0 URIBL_BLOCKED ADMINISTRATOR NOTICE: The query to URIBL was blocked.
See
http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block
for more information.
[URIs: zimbra.com]
-0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay
domain
-0.0 SPF_PASS SPF: sender matches SPF record
-1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1%
[score: 0.0000]
-0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from author's
domain
0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily valid
-0.1 DKIM_VALID Message has at least one valid DKIM or DK signature

OpenLDAP 2.4.42 Engineering
Fixed liblber address length for CLDAP (ITS#8158)
Fixed libldap dnssrv potential overflow with port number
(ITS#7027,ITS#8195)
Fixed slapd cn=config when updating olcAttributeTypes (ITS#8199)
Fixed slapd-mdb to correctly update search candidates for scoped
searches (ITS#8203)
Fixed slapo-ppolicy with redundant mod ops on glued trees (ITS#8184)
Build Environment
Fixed libdb detection with gcc 5.x (ITS#8056)

LMDB 0.9.16 Release Engineering
Fix cursor EOF bug (ITS#8190)
Fix handling of subDB records (ITS#8181)
Fix mdb_midl_shrink() usage (ITS#8200)


This release is primarly addressing crash related problems and to fix the
configure script for gcc 5.x.

Thanks!

--Quanah

--

Quanah Gibson-Mount
Platform Architect
Zimbra, Inc.
--------------------
Zimbra :: the leader in open source messaging and collaboration

[Michael Ströder]

Post by Quanah Gibson-Mount
OpenLDAP 2.4.42 Engineering
[..]
This release is primarly addressing crash related problems and to fix the
configure script for gcc 5.x.

Build and "make test" worked on openSUSE Tumbleweed x86_64 with gcc 5.1.1.

Ciao, Michael.

[Aaron Richton]

Content preview: On Wed, 29 Jul 2015, Quanah Gibson-Mount wrote: > OpenLDAP
2.4.42 Engineering Hmm. Getting failures for test020 using mdb: [...]

Content analysis details: (-1.9 points, 5.0 required)

pts rule name description
---- ---------------------- --------------------------------------------------
-0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay
domain
-1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1%
[score: 0.0000]

Post by Quanah Gibson-Mount
OpenLDAP 2.4.42 Engineering

Hmm. Getting failures for test020 using mdb:

$ diff -u ldapsearch.flt ldif.flt
--- ldapsearch.flt 2015-08-03 12:30:47.171602000 -0400
+++ ldif.flt 2015-08-03 12:30:47.219532000 -0400
@@ -232,9 +232,9 @@
uid: bjensen
title: Mythical Manager, Research Systems

-dn: cn=Bjorn Jensen,ou=Information Technology Division,ou=People,dc=example,dc
- =com
-mail: ***@mailgw.example.com
+dn: cn=Barbara Jensen,ou=Information Technology Division,ou=People,dc=example,
+ dc=com
+mail: ***@mailgw.example.com

dn: cn=All Staff,ou=Groups,dc=example,dc=com
cn: All Staff




On OPENLDAP_REL_ENG_2_4_41-23-g1b1b294, consistent across Solaris and
Linux.

[Howard Chu]

Content preview: Aaron Richton wrote: > On Wed, 29 Jul 2015, Quanah Gibson-Mount
wrote: > >> OpenLDAP 2.4.42 Engineering > > Hmm. Getting failures for test020
using mdb: Weird. Not seeing any problems here. > > $ diff -u ldapsearch.flt
ldif.flt > --- ldapsearch.flt 2015-08-03 12:30:47.171602000 -0400 > +++ ldif.flt

title: Mythical Manager, Research Systems > > -dn: cn=Bjorn Jensen,ou=Information
+dn: cn=Barbara Jensen,ou=Information Technology Division,ou=People,dc=example,
cn: All Staff > > > > > On OPENLDAP_REL_ENG_2_4_41-23-g1b1b294, consistent

across Solaris and Linux. > > > > [...]

Content analysis details: (-1.9 points, 5.0 required)

pts rule name description
---- ---------------------- --------------------------------------------------
0.0 URIBL_BLOCKED ADMINISTRATOR NOTICE: The query to URIBL was blocked.
See
http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block
for more information.
[URIs: highlandsun.com]
-1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1%
[score: 0.0000]

Post by Quanah Gibson-Mount
OpenLDAP 2.4.42 Engineering

Weird. Not seeing any problems here.

$ diff -u ldapsearch.flt ldif.flt
--- ldapsearch.flt 2015-08-03 12:30:47.171602000 -0400
+++ ldif.flt 2015-08-03 12:30:47.219532000 -0400
@@ -232,9 +232,9 @@
uid: bjensen
title: Mythical Manager, Research Systems
-dn: cn=Bjorn Jensen,ou=Information Technology Division,ou=People,dc=example,dc
- =com
+dn: cn=Barbara Jensen,ou=Information Technology Division,ou=People,dc=example,
+ dc=com
dn: cn=All Staff,ou=Groups,dc=example,dc=com
cn: All Staff
On OPENLDAP_REL_ENG_2_4_41-23-g1b1b294, consistent across Solaris and Linux.

[Aaron Richton]

Content preview: On Mon, 3 Aug 2015, Howard Chu wrote: >> Hmm. Getting failures
for test020 using mdb: > > Weird. Not seeing any problems here. Tried a complete-brand-new
clone and it did take three iterations before failure...so looks like it's
not a 100% thing. [...]

Content analysis details: (-1.9 points, 5.0 required)

pts rule name description
---- ---------------------- --------------------------------------------------
-0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay
domain
-1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1%
[score: 0.0000]

Post by Howard Chu
Weird. Not seeing any problems here.

Tried a complete-brand-new clone and it did take three iterations before
failure...so looks like it's not a 100% thing.

[Gavin Henry]

Content preview: No issues here on Fedora 22 x86_64 [...]

Content analysis details: (-1.9 points, 5.0 required)

pts rule name description
---- ---------------------- --------------------------------------------------
-0.0 SPF_PASS SPF: sender matches SPF record
-1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1%
[score: 0.0000]

No issues here on Fedora 22 x86_64

[Quanah Gibson-Mount]

Content preview: --On Monday, August 03, 2015 2:55 PM -0400 Aaron Richton <***@nbcs.rutgers.edu>
wrote: > On Mon, 3 Aug 2015, Howard Chu wrote: > >>> Hmm. Getting failures
for test020 using mdb: >> >> Weird. Not seeing any problems here. > > Tried
a complete-brand-new clone and it did take three iterations before > failure...so
looks like it's not a 100% thing. [...]

Content analysis details: (-2.0 points, 5.0 required)

pts rule name description
---- ---------------------- --------------------------------------------------
0.0 URIBL_BLOCKED ADMINISTRATOR NOTICE: The query to URIBL was blocked.
See
http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block
for more information.
[URIs: zimbra.com]
-0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay
domain
-0.0 SPF_PASS SPF: sender matches SPF record
-1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1%
[score: 0.0000]
-0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from author's
domain
0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily valid
-0.1 DKIM_VALID Message has at least one valid DKIM or DK signature

--On Monday, August 03, 2015 2:55 PM -0400 Aaron Richton

Post by Aaron Richton

Post by Howard Chu
Weird. Not seeing any problems here.

Tried a complete-brand-new clone and it did take three iterations before
failure...so looks like it's not a 100% thing.

Same here:

Filtering ldapsearch results...
Filtering original ldif...
Comparing filter output...
Comparison failed
Failed after 6 of 100 iterations


--Quanah

--

Quanah Gibson-Mount
Platform Architect
Zimbra, Inc.
--------------------
Zimbra :: the leader in open source messaging and collaboration

[Quanah Gibson-Mount]

Content preview: --On Monday, August 03, 2015 2:41 PM -0700 Quanah Gibson-Mount
<***@zimbra.com> wrote: > --On Monday, August 03, 2015 2:55 PM -0400 Aaron
Richton > <***@nbcs.rutgers.edu> wrote: > >> On Mon, 3 Aug 2015, Howard
Chu wrote: >> >>>> Hmm. Getting failures for test020 using mdb: >>> >>> Weird.
Not seeing any problems here. >> >> Tried a complete-brand-new clone and
it did take three iterations before >> failure...so looks like it's not a
100% thing. > > Same here: > > Filtering ldapsearch results... > Filtering
original ldif... > Comparing filter output... > Comparison failed > Failed
after 6 of 100 iterations [...]

Content analysis details: (-2.0 points, 5.0 required)

pts rule name description
---- ---------------------- --------------------------------------------------
0.0 URIBL_BLOCKED ADMINISTRATOR NOTICE: The query to URIBL was blocked.
See
http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block
for more information.
[URIs: zimbra.com]
-0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay
domain
-0.0 SPF_PASS SPF: sender matches SPF record
-1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1%
[score: 0.0000]
-0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from author's
domain
0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily valid
-0.1 DKIM_VALID Message has at least one valid DKIM or DK signature

--On Monday, August 03, 2015 2:41 PM -0700 Quanah Gibson-Mount

Post by Quanah Gibson-Mount
--On Monday, August 03, 2015 2:55 PM -0400 Aaron Richton

Post by Aaron Richton

Post by Howard Chu
Weird. Not seeing any problems here.

Tried a complete-brand-new clone and it did take three iterations before
failure...so looks like it's not a 100% thing.

Filtering ldapsearch results...
Filtering original ldif...
Comparing filter output...
Comparison failed
Failed after 6 of 100 iterations

Correction -- I can repo this with 2.4.41 as well, so it isn't new.

--Quanah


--

Quanah Gibson-Mount
Platform Architect
Zimbra, Inc.
--------------------
Zimbra :: the leader in open source messaging and collaboration

[Quanah Gibson-Mount]

Content preview: --On Monday, August 03, 2015 3:02 PM -0700 Quanah Gibson-Mount
<***@zimbra.com> wrote: > --On Monday, August 03, 2015 2:41 PM -0700 Quanah
Gibson-Mount > <***@zimbra.com> wrote: > >> --On Monday, August 03, 2015
2:55 PM -0400 Aaron Richton >> <***@nbcs.rutgers.edu> wrote: >> >>> On
Mon, 3 Aug 2015, Howard Chu wrote: >>> >>>>> Hmm. Getting failures for test020
using mdb: >>>> >>>> Weird. Not seeing any problems here. >>> >>> Tried a
complete-brand-new clone and it did take three iterations before >>> failure...so
looks like it's not a 100% thing. >> >> Same here: >> >> Filtering ldapsearch
results... >> Filtering original ldif... >> Comparing filter output... >>
Comparison failed >> Failed after 6 of 100 iterations > > Correction -- I
can repo this with 2.4.41 as well, so it isn't new. [...]

Content analysis details: (-2.0 points, 5.0 required)

pts rule name description
---- ---------------------- --------------------------------------------------
0.0 URIBL_BLOCKED ADMINISTRATOR NOTICE: The query to URIBL was blocked.
See
http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block
for more information.
[URIs: zimbra.com]
-0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay
domain
-0.0 SPF_PASS SPF: sender matches SPF record
-1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1%
[score: 0.0000]
-0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from author's
domain
0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily valid
-0.1 DKIM_VALID Message has at least one valid DKIM or DK signature

--On Monday, August 03, 2015 3:02 PM -0700 Quanah Gibson-Mount

Post by Quanah Gibson-Mount
--On Monday, August 03, 2015 2:41 PM -0700 Quanah Gibson-Mount

Post by Quanah Gibson-Mount
--On Monday, August 03, 2015 2:55 PM -0400 Aaron Richton

Post by Aaron Richton

Post by Howard Chu
Weird. Not seeing any problems here.

Tried a complete-brand-new clone and it did take three iterations before
failure...so looks like it's not a 100% thing.

Filtering ldapsearch results...
Filtering original ldif...
Comparing filter output...
Comparison failed
Failed after 6 of 100 iterations

Correction -- I can repo this with 2.4.41 as well, so it isn't new.

I routinely get failures of a different sort in 2.4.40 (slapd fails to
start), so it appears this issue was introduced with 2.4.41.

--Quanah

--

Quanah Gibson-Mount
Platform Architect
Zimbra, Inc.
--------------------
Zimbra :: the leader in open source messaging and collaboration

[Howard Chu]

Content preview: Quanah Gibson-Mount wrote: > --On Monday, August 03, 2015
2:41 PM -0700 Quanah Gibson-Mount > <***@zimbra.com> wrote: > >> --On Monday,
August 03, 2015 2:55 PM -0400 Aaron Richton >> <***@nbcs.rutgers.edu>
wrote: >> >>> On Mon, 3 Aug 2015, Howard Chu wrote: >>> >>>>> Hmm. Getting
failures for test020 using mdb: >>>> >>>> Weird. Not seeing any problems
here. >>> >>> Tried a complete-brand-new clone and it did take three iterations

Post by Quanah Gibson-Mount

Post by Aaron Richton

Filtering ldapsearch results... >> Filtering original ldif... >> Comparing

filter output... >> Comparison failed >> Failed after 6 of 100 iterations

Post by Quanah Gibson-Mount

Correction -- I can repo this with 2.4.41 as well, so it isn't new. [...]

Content analysis details: (-1.9 points, 5.0 required)

pts rule name description
---- ---------------------- --------------------------------------------------
0.0 URIBL_BLOCKED ADMINISTRATOR NOTICE: The query to URIBL was blocked.
See
http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block
for more information.
[URIs: highlandsun.com]
-1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1%
[score: 0.0000]

Post by Quanah Gibson-Mount
--On Monday, August 03, 2015 2:41 PM -0700 Quanah Gibson-Mount

--On Monday, August 03, 2015 2:55 PM -0400 Aaron Richton

Post by Aaron Richton

Weird. Not seeing any problems here.

Tried a complete-brand-new clone and it did take three iterations before
failure...so looks like it's not a 100% thing.

Filtering ldapsearch results...
Filtering original ldif...
Comparing filter output...
Comparison failed
Failed after 6 of 100 iterations

Correction -- I can repo this with 2.4.41 as well, so it isn't new.

I've had a look at some successful and failed runs. The difference is again,
purely timing-related. On the failed runs the pcache thread hasn't finished
storing the cached entries by the time the next search starts. Inserting
sleeps into the test script makes the problem go away. Also, configuring the
cache DBs with dbnosync also makes the problem go away. I'll commit the latter
change.

[Quanah Gibson-Mount]

Content preview: --On Tuesday, August 04, 2015 2:22 PM +0100 Howard Chu <***@symas.com>
wrote: > I've had a look at some successful and failed runs. The difference
is > again, purely timing-related. On the failed runs the pcache thread hasn't

finished storing the cached entries by the time the next search starts.
Inserting sleeps into the test script makes the problem go away. Also,
configuring the cache DBs with dbnosync also makes the problem go away.
I'll commit the latter change. [...]

Content analysis details: (-2.0 points, 5.0 required)

pts rule name description
---- ---------------------- --------------------------------------------------
0.0 URIBL_BLOCKED ADMINISTRATOR NOTICE: The query to URIBL was blocked.
See
http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block
for more information.
[URIs: zimbra.com]
-0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay
domain
-0.0 SPF_PASS SPF: sender matches SPF record
-1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1%
[score: 0.0000]
-0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from author's
domain
0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily valid
-0.1 DKIM_VALID Message has at least one valid DKIM or DK signature

I've had a look at some successful and failed runs. The difference is
again, purely timing-related. On the failed runs the pcache thread hasn't
finished storing the cached entries by the time the next search starts.
Inserting sleeps into the test script makes the problem go away. Also,
configuring the cache DBs with dbnosync also makes the problem go away.
I'll commit the latter change.

Pushed to RE24.

Aaron, can you please re-test and confirm it is resolved in your setup?

Thanks,
Quanah

--

Quanah Gibson-Mount
Platform Architect
Zimbra, Inc.
--------------------
Zimbra :: the leader in open source messaging and collaboration

[Aaron Richton]

Content preview: On Tue, 4 Aug 2015, Quanah Gibson-Mount wrote: > Aaron, can
you please re-test and confirm it is resolved in your setup? test020 seems
clean now. [...]

Content analysis details: (-1.9 points, 5.0 required)

pts rule name description
---- ---------------------- --------------------------------------------------
-0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay
domain
-1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1%
[score: 0.0000]

Post by Quanah Gibson-Mount
Aaron, can you please re-test and confirm it is resolved in your setup?

test020 seems clean now.