Merge pull request #53 from hypermail-project/applemail_hack

Merging to master for 2.4.0 release

Author: jkbzh

.gitignore

@@ -1,4 +1,5 @@
 # ignore all files generated by configure and make
+autom4te.cache
 config.cache
 config.h
 config.log
@@ -7,6 +8,7 @@ Makefile
 *.la
 *.lo
 *.o
+*.so.*
 *.a
 .libs/
 src/defaults.h
@@ -16,21 +18,39 @@ src/getdate.c
 src/hypermail
 src/lang
 src/mail
+
+# PCRE (if using the bundled lib)
+src/pcre/.deps
+src/pcre/.deps/
+src/pcre/autom4te.cache/
+src/pcre/libpcre.pc
+src/pcre/libpcre16.pc
+src/pcre/libpcre32.pc
+src/pcre/libpcrecpp.pc
+src/pcre/libpcreposix.pc
+src/pcre/pcre_chartables.c
+src/pcre/pcre_scanner_unittest
+src/pcre/pcre_stringpiece.h
+src/pcre/pcre_stringpiece_unittest
+src/pcre/pcrecpp_unittest
+src/pcre/pcrecpparg.h
+src/pcre/stamp-h1
 src/pcre/pcre.h
-src/pcre/chartables.c
 src/pcre/pcre-config
-src/pcre/RunTest
-src/pcre/RunTest
 src/pcre/dftables
 src/pcre/libtool
 src/pcre/pcregrep
 src/pcre/pcretest
-tests/testhm
+
+# other files created when compiling
 archive/msg2archive
 archive/rdmsg
+tests/testhm
+tests/testdir
+tests/testmail
 
 # vi or emacs edited ones
-*.~
+.*~
 \#.*
 
 # swap files

Changelog

@@ -1,98 +1,241 @@
 Version Changes for Hypermail
 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
 ============================
-HYPERMAIL VERSION 2.3.1:
+HYPERMAIL VERSION 2.4.0:
 ============================
 
- Jose Kahan (June 19, 2018)
-  - Changed mispelled configuration option warn_surpressions to the
-    correct spelling warn_suppressions.
-
- Jose Kahan (June 14, 2018)
-  - Hypermail would segfault or have an incorrect thread view if it was
-    handling an archive with a message (msg1) that was a reply to a message not
-    in the archive, if msg1 had a reply to it in the archive (msg2), msg2 was
-    archived before msg1 and both msg1 and msg2 shared the same subject
-    (regardless of Re: prefixes).
-
- Bill Shannon (June 7, 2018)
-  - Add charset alias for Thai and Chinese
-  - The markup for access key "j" to jump to the start of a message
-    was only being added when the showhtml configuration option
-    was disabled
-  - Setting the describe_folder configuration option has no effect on the
-    display of the folder index page
-  - In some cases hypermail failed to null terminate the charset name
-    when copying it, resulting in bogus charset names
-  - Hypermail would segfault if given the bogus From line "From: <a@b.com"
-  - In some cases, when no new message was added to the archive,
-    would segfault because of a null pointer
+2019-12-20 Jose Kahan
+	* src/getdate.y
+	A message's sent or received date with a specified TZ but without any
+	seconds value was using the local date seconds value instead of 00.
 
-============================
-HYPERMAIL VERSION 2.3.0:
-============================
+2019-12-19 Jose Kahan
+	* src/parse.c
+	parsemail(): a Content-Transfer-Encoding header with a missing value
+	would result in an unitialized variable being used to output an unknown
+	encoding warning message. Hypermail now skips this header if it's empty.
+
+2019-11-22 Jose Kahan
+	* src/print.c
+	printsubject() / printdates(): the "by suject" and "by dates" views
+	were not escaping markup present in mail's Suject and From headers.
+
+2019-11-19 Jose Kahan
+	* src/pcre
+	Upgraded to upstream version 8.43. This fixes some autoconf issues we
+	had on newer debian releases. This is only relevant for people that
+	are not linking against a system libpcre.
+
+	* tests/diff_hypermail_archives.pl
+	Rewrote diff_hypermail.pl to make it more flexible and powerful for
+	finding the differences in two hypermail archives.
+
+2018-12-07 Jose Kahan
+	* If the antispamdomain config option was used, hypermail was replacing
+	everything following a "@" character by the antispam domain.  This fix
+	makes antispamdomain only apply for the domain part of valid email
+	addresses.
+
+2018-11-29 Bill Shannon
+	* string.c
+	spamify_replacedomain(): fix another greedy "@" replacement in the
+	middle of a string of iso-2022-jp encoded Japanese characters.
+
+2018-11-04 Bill Shannon
+	* string.c
+	i18n_convstring(): When converting a utf-8 string to iso-2022-jp,
+	hypermail always adds the "return to ASCII" escape sequence, even if
+	the string ends with ASCII.
+
+	parseemail(): hypermail attempts to transform anything that looks like
+	an email address by replacing the at sign (and optionally the domain
+	name) with a string (default "at") to confuse screen-scraping
+	programs. But if there's an "@" character in the middle of a string of
+	iso-2022-jp encoded Japanese characters, hypermail still converts it,
+	breaking the Japanese character.
+
+2018-10-12 Jose Kahan
+	* setup.c PreConfig(): removed a 64-bit warning
+
+	* hypermail.c
+	main(): if the en_US locale is not available, try en_US.UTF-8
+
+2018-10-11 Jose Kahan
+
+	* string.c
+	parseemail(): for some reason if a ',' char was concatenaned to an
+	email address, it was being parsed as part of the email username.
+
+2018-10-10 Jose Kahan
+
+	* string.c
+	parseurl(): remove deprecated URLs. Improve support for URLs that don't
+	have slashes following the 'protocol:' schema. Improve support for tel:
+	URLs.
+
+2018-10-09 Bill Shannon
+
+	* string.c
+	parseurl(): non-URL text can be misinterpreted as a URL, causing segfault
+	Fixes issue #39
+
+2018-10-08 Jose Kahan
+
+	* print.c, string.c, proto.h
+	The inreplyto_command could generate invalid links if the parser interpolated the
+	in-reply-to from the subject. If a message's in-reply-to is interpolated,
+	hypermail won't honor it anymore for that message.
+
+2018-10-07 Jose Kahan
+
+	* print.c printauthors(), printthreads(), printsubjects, printdates()
+	Even if set_i18n was enabled, Indexes were written with mixed charsets
+	instead of using utf-8 throughout.
+
+	* configure.ac, Makefile.in, src/Makefile.in
+	If the system has a recent libpcre, compile against it instead of using
+	the bundled one. This check is done by default when launching configure.
+
+	New configure options to allow to link against an external pcre library
+	(--with-external-pcre) or to force the build and link against the
+	bundled one (--enable-bundled-pcre).
+
+	New configure option to allow to compile against a system libtrio
+	(--enable-system-libtrio). Contrary to libpcre, it's not possible to find the
+	version of libtrio so we cannot compile automatically against it.
+
+2018-10-04 Jose Kahan
+
+	* src/pcre
+	Upgraded to upstream version 8.42
+
+	* src/trio
+	Upgraded to upstream version 1.16
+
+	* parse.c
+	Only use the headers charset for text/plain if its absent. If no charset
+	is available in the other parts, do not add it.
+
+2018-10-04 Jose Kahan
+
+	* Updated Changelog format for entries newer than version 2.3.0
+
+	* hypermail.h, parse.c, struct.c, struct.h
+	Charset handling for multipart messages was being handled wrong, giving
+	priority to the headers charset (if found) over that of the displayed body.
+	Sometimes the last found charset was the one being used throughout in the
+	generated body.
+
+	The metafile for attachments was sometimes inheriting the charset of the whole
+	body, even when not necessary or wrong. Now the meta doesn't include a charset
+	if the attachment doesn't explicitly give one.
+
+	* parse.c
+	References header was processed multiple times as it was not being marked as parsed
+	after being processed.
+	The epilogue of MIME parts was not being ignored.
+
+2018-06-19 Jose Kahan
+
+	* Changed mispelled configuration option warn_surpressions to the
+	correct spelling warn_suppressions.
+
+2018-06-14 Jose Kahan
+
+	* Hypermail would segfault or have an incorrect thread view if it was
+	handling an archive with a message (msg1) that was a reply to a message
+	not in the archive, if msg1 had a reply to it in the archive (msg2),
+	msg2 was archived before msg1 and both msg1 and msg2 shared the same
+	subject (regardless of Re: prefixes).
+
+2018-06-07 Bill Shannon
+
+	* Add charset alias for Thai and Chinese
+
+	* The markup for access key "j" to jump to the start of a message was
+	only being added when the showhtml configuration option was disabled
+
+	* Setting the describe_folder configuration option has no effect on the
+	display of the folder index page
+
+	* In some cases hypermail failed to null terminate the charset name
+	when copying it, resulting in bogus charset names
+
+	* Hypermail would segfault if given the bogus From line "From:
+	<a@b.com"
+
+	* In some cases, when no new message was added to the archive, would
+	segfault because of a null pointer
+
+2015-04-03 Ivan Kuraj
 
-Ivan Kuraj (Apr 3, 2015)
 	* Correct includes for new glibc
 
-Jose Kahan (Jun 10, 2013)
+2013-06-10 Jose Kahan
+
 	* Even if a message was annotated as spam/deleted, its Attachments were
 	still being created
 
-Jose Kahan (Apr 18, 2013)
+2013-04-18 Jose Kahan
+
 	* Removed commented out code in printfile.c.
+
 	* Added missing ';' in generated css rules in the same file
 
-Jose Kahan (Apr 11, 2013)
+2013-04-11 Jose Kahan
+
 	* Extended the configure options so that a user can decide if hypermail
 	should be compiled and statically linked against the bundled pcre lib
 	or if it should be dynamically linked with an external (or system) pcre
 	library (if available).
+
 	* The new configure option is --with-external-pcre[=dir].
+
 	* The default value for dir is /usr and the include and libraries
 	directories will be searched from that starting path. This option is
 	disabled by default.
+
 	* The make clean in libfnv wasn't removing the libfnv.a file
 
-Jose Kahan (Mar 29, 2013)
+2013-03-29 Jose Kahan
 
 	* Updated configure to latest autoconf syntax conventions.
 
 	* Renamed configure.in to configure.ac and cleaned it up partially.
 
-Jose Kahan (Mar 20, 2013)
-	
+2013-03-20 Jose Kahan
+
 	* Updated pcre to pcre-8.32 from pcre-4.3. This may have broken the
 	Windows lcc compilation but I don't have the means to verify it.
 
-Jose Kahan (Mar 15, 2013)
-	
+2013-03-15 Jose Kahan
+
 	* Updated trio code to trio version 1.14. Moved all the trio code to
 	src/trio. Now compiling trio as a static library and linking against
 	it, which makes binary a bit smaller. See src/trio/README.hypermail for
 	details.
 
-Jose Kahan (Mar 12, 2013)
-	
+2013-03-12 Jose Kahan
+
 	* New experimental support for RFC 3676 format=flowed. There are two
 	new related configuration options: format_flowed to enable it and
 	format_flowed_disable_quotes to disable it in specific cases.  See the
 	documentation and the RFC for further info.
 
-Jose Kahan (Mar 08, 2013)
-	
+2013-03-08 Jose Kahan
+
 	* Error: string.c:parseurl() assumes that all URL motifs it can match
 	end with a :// string. However, the URL match table it uses included
 	some URL motifs that didn't have that string. These have been commented
 	as they may cause parseulr to SIGSEVs in some cases.
 
-Jose Kahan (Feb 26, 2013)
-	
+2013-02-26 Jose Kahan
+
 	* New configuration option, noindex_onindexes, for associating a
 	"noindex" robot metadata value with hypermail generated indexes.
 
-Jose Kahan (Feb 26, 2013)
-	
+2013-02-26 Jose Kahan
+
 	* New configuration option, userobotmeta, for Associatating robot
 	annotations with attachments, using the experimental X-Robots-Tag HTTP
 	header
@@ -104,28 +247,28 @@ Jose Kahan (Feb 26, 2013)
 	* Make sure the delete stubs are added only when the delete_level
 	option says we're not to preserve the original message body.
 
-Jose Kahan (Jan 30, 2013)
-	
+2013-01-30 Jose Kahan
+
 	* Migrated source code repository from cvs.hypermail.org to
 	http://sourceforge.net/projects/hypermail/
-	
+
 	* Added a mirror of the repository to github:
 	http://github.com/hypermail-project/hypermail
-	
+
 	* Cleared up the markup errors in docs/hmrc.html by using tidy.
-	
+
 	* New configuration directive "annotated" which allows a mailing list
 	archive editor to annotate a given message before converting it into
 	HTML. Associated additional new directives are
 	"htmlmessage_deleted_spam", "htmlmessage_deleted_other",
 	"htmlmessage_edited". Consult docs/hmrc.html for more info.
-	
+
 	* "htmlmessage_deleted" is deprecated in favor of
 	"htmlmessage_deleted_spam"
-	
+
 	* "deleted" is superseded by "annotated", although it will be supported
 	to take into account legacy archives.
-	
+
 	* Regenerated the dependencies for the src/Makefile.in file.
 
 ============================