Ajcody-MailingLists-And-Mailman: Difference between revisions

mNo edit summary
 
(42 intermediate revisions by 2 users not shown)
Line 1: Line 1:
==Mailing Lists, Distribution Lists, And Mailman==
{{BC|Zeta Alliance}}                        <!-- Note, this will also add [[Category: Zeta Alliance]] to bottom of wiki page. -->
__FORCETOC__                              <!-- Will force a TOC regards of size of article. __NOTOC__  if no TOC is wanted. -->
<div class="col-md-12 ibox-content">
==Mailing Lists, Distribution Lists, And Mailman==             <!-- Normally will reflect page title. Is listed at very top of page. -->
{{KB|{{ZETA}}|{{ZCS 8.5}}|{{ZCS 8.0}}|{{ZCS 7.0}}|}}            <!-- Can only handle 3 ZCS versions. -->
{{WIP}}                                                <!-- For pages that are "work in progress". -->
 


===Actual Mailing Lists And Mailman Notes Homepage===
===Actual Mailing Lists And Mailman Notes Homepage===
Line 5: Line 11:
Please see [[Ajcody-MailingLists-And-Mailman]]
Please see [[Ajcody-MailingLists-And-Mailman]]


===Introduction And Choices===
===Introduction And Choices - When Email Lists Have More Than 1000+ Recipients===
If you are planning to use a distro list of over 60K members, you may be inclined to use a dedicated machine for this purpose. According to bug 19153, you have 2 options: "set up mailing list manager or change the value of virtual_alias_expansion_limit as a customization. We have never tested with > 1000 so this should be done carefully, and will pound LDAP for any messages with lots of recipients." Mailman integration is an option. There is a forum thread on how to integrate zcs and mailman. This would be the preferred fix to your issue, also noted in the bug report. We probably won't see Mailman integration in ZCS at least for another year or so, not until 6.0
 
If you are planning to use a distro list with 1000 to 3000 or more members, you should consider using a 3rd party mailing list software machine for this. This is the recommendation of the developers according the the bug/rfe's I reference below. According to bug 19153, you have 2 options:  
 
# "set up mailing list manager or change the value of virtual_alias_expansion_limit as a customization. We have never tested with > 1000 so this should be done carefully, and will pound LDAP for any messages with lots of recipients."  
# Mailman integration or another third party mailing list software package. There is a forum thread on how to integrate zcs and mailman. This would be the preferred fix to your issue, also noted in the bug report. We probably won't see Mailman integration in ZCS at least for another year or so, not until 6.0
 
Main Bug/RFE's to review:
 
* "Problems resolving virtual aliases for members of large distribution lists"
** https://bugzilla.zimbra.com/show_bug.cgi?id=19153
*** '''Note''' - this is marked as a duplicate of bug 8968, "Mailman Integration".
*** Comment 3 : ''"We have never tested with > 1000 so this should be done carefully, and will pound LDAP for any messages with lots of recipients."''
**** '''Note''' - In ZCS 8, '''''"Release notes: If dynamic lists are used, the default is to allow lists of up to 10,000 members.  This can be controlled via the localconfig key postfix_virtual_alias_expansion_limit"'''''
***** This does '''NOT''' resolve the issues for large email lists though, the recommendation is still to be using a dedicated mailing list software package.
****** "too many recipients error when sending mail to dynamic lists with 1100+ members"
****** https://bugzilla.zimbra.com/show_bug.cgi?id=64030
*** Comment 5 : '''''the answer for large lists is to use mailman. See bug 8968 and bug 21621'''''
* "Mailman Integration"
** Note - this RFE is really about including mailing list functionality within ZCS, it isn't fully committed to Mailman being that solution at this time.
** https://bugzilla.zimbra.com/show_bug.cgi?id=8968
* "Test and document manual mailman integration"
** https://bugzilla.zimbra.com/show_bug.cgi?id=21621
*** "This article [below] is a community contribution and may include unsupported customizations for network edition customers."
**** http://wiki.zimbra.com/index.php?title=ZCS_Mailman_Integration
 
 
Other Bug/RFE's to review to see the full conversation on this from our developers - '''Note''' , it's important to note the bugs they are making duplicates of the main ones mentioned above.
 
* RFE - "integrate zimbra with sympa.org"
** http://bugzilla.zimbra.com/show_bug.cgi?id=33712
* RFE - "Mail policies and access control for sending to distribution lists"
** http://bugzilla.zimbra.com/show_bug.cgi?id=9620
* RFE: Mailing List Feature
** https://bugzilla.zimbra.com/show_bug.cgi?id=16254
* Reply-to mailing list option
** https://bugzilla.zimbra.com/show_bug.cgi?id=13631
* distribution list -- moderator
** https://bugzilla.zimbra.com/show_bug.cgi?id=19579
* Integration of Mailman or EZLM
** https://bugzilla.zimbra.com/show_bug.cgi?id=33708
* Auto Reply for Distribution Lists.
** https://bugzilla.zimbra.com/show_bug.cgi?id=18570
* auto-reply feature within distribution lists
** https://bugzilla.zimbra.com/show_bug.cgi?id=37376
* Autorespond for a MailList Account
** https://bugzilla.zimbra.com/show_bug.cgi?id=37256
* Distribution Lists Sequence Number
** https://bugzilla.zimbra.com/show_bug.cgi?id=39479
* Ability for external users to unsubscribe from a Zimbra Distribution List
** https://bugzilla.zimbra.com/show_bug.cgi?id=81353
 
 
References to Maining list software options:
 
* http://www.list.org/ - Mailman
* https://www.sympa.org/ - Sympa
* http://mlmmj.org/ - Mailing List Management Made Joyful


===Restricting Who Can Send To Mailing List===
===Restricting Who Can Send To Mailing List===


http://wiki.zimbra.com/index.php?title=RestrictPostfixRecipients
These are unsupport customizations. Please be sure to make backup copies of modifications to prevent lost after upgrades/restores of Zimbra.
 
Please see:
* See the whole sub-section of this topic as well.
** [[Ajcody-MTA-Postfix-Topics#Blocking_MAIL_FROM_-_smtpd_sender_restrictions_-_Default_Is_Empty]]
 
 
Also see the following RFE:
* "Mail policies and access control for sending to distribution lists"
** http://bugzilla.zimbra.com/show_bug.cgi?id=9620
 
===Restrict Sending To Certain Domains===
 
Please see:
*[[Restrict_sending_to_certain_domains]]
 
===Add Everyone To Distribution List - Admin Console===
 
RFE was made for this:
* "Admin>DistributionList: AddAll to add members that are in only current-search-page"
** http://bugzilla.zimbra.com/show_bug.cgi?id=13016
 
===Everyone@domain Without Manually Adding Users To A DL===
 
Investigating if this can be done. Please don't attempt anything below, I'm simply keeping track of my "notes" here.
 
'''DON'T ATTEMPT ANY OF THIS! THIS WILL MOST LIKELY GET POSTED INTO BUGZILLA AS AN RFE'''
 
RFE Made For This:
* http://bugzilla.zimbra.com/show_bug.cgi?id=32341
** Was marked as a duplicate of the following:
*** "Dynamic distribution lists"
**** http://bugzilla.zimbra.com/show_bug.cgi?id=3884
 
One Possible Way Described In An External Resource:
* [http://translate.google.com/translate?hl=en&sl=ru&u=http://www.postfix.ru/viewtopic.php%3Ft%3D853%26highlight%3Dldap&sa=X&oi=translate&resnum=8&ct=result&prev=/search%3Fq%3Dpostfix%2Beveryone%2540domain%2Bldap%26start%3D10%26hl%3Den%26client%3Dfirefox-a%26rls%3Dorg.mozilla:en-US:official%26sa%3DN With Ldap Calls]
<pre>
main.cf:
there is a line to resolve aliases:
virtual_aias_maps = ldap: $ config_directory / ldap / ldap-aliases.cf
 
ldap-aliases.cf
that relates to filter:
query_filter = (&(objectclass=mailgroup)(|(mail=%s)(mailalternateaddress=%s)))
result_attribute = mail result_attribute = mail
special_result_attribute = uniqueMember, memberUrl
 
in LDAP-e for everyone is recording with such attributes:
mail = everyone@domain.ru
memberurl = ldap :///ou=People,o=organization??sub? (&(objectclass=person)(uid=*))
objectclass=mailgroup
</pre>
* Had to use the following to get it to work:
<pre>
receive_override_options = no_address_mappings
Was a global setting.
</pre>
 
Another Possible Way, again an external resource:
* [https://www.linuxquestions.org/questions/linux-software-2/postfix-and-ldap-virtual-user-question-369667/  Use Of mailAlternateAddress]
** Confirmation that it can be done?
*** http://archives.devshed.com/forums/networking-100/aliases-and-mailalternateaddress-529765.html
** New LDAP map transports:
*** http://www.usenet-forums.com/mailing-postfix-users/191425-wildcard-transport-map-via-ldap.html#post556822


===Problems Resolving Virtual Aliases For Members Of Large Distribution Lists===
===Problems Resolving Virtual Aliases For Members Of Large Distribution Lists===
Line 18: Line 143:


Other wiki page is here - [[Error_(MTA):_unreasonable_virtual_alias_maps_map_expansion_size]]
Other wiki page is here - [[Error_(MTA):_unreasonable_virtual_alias_maps_map_expansion_size]]


The default expansion that will be done is for 1000 accounts.
The default expansion that will be done is for 1000 accounts.
Line 30: Line 154:
Check configuration
Check configuration


  $ postconf virual_alias_expansion_limit
  $ postconf virtual_alias_expansion_limit


Set configuration
Set configuration
Line 41: Line 165:
  $ postfix start
  $ postfix start


===Mailman Configuration===
===Mailman - Mailing List Manager===
 
Please see the following:
 
* [[ZCS_Mailman_Integration]]
* RFE - "Mailman Integration"
** http://bugzilla.zimbra.com/show_bug.cgi?id=8968
* http://www.zimbra.com/forums/administrators/1380-solved-zimbra-mailman-howto.html
 
===Sympa - Mailing List Manager===
 
This might be another option to Mailman that might even be better.


http://wiki.zimbra.com/index.php?title=ZCS_Mailman_Integration
https://www.sympa.org/overview/features


http://bugzilla.zimbra.com/show_bug.cgi?id=8968
Someone made this comment on the zimbra-heid-admins@sfu.ca list :


http://www.zimbra.com/forums/administrators/1380-solved-zimbra-mailman-howto.html
''"We recently switched from mailman to sympa, which does the same thing.  Sympa allows membership data sources to be defined from SQL queries, ldap queries, and more.  I'm very pleased with it."''
 
Some customers are advocating for it over Mailman on this RFE:
 
* RFE - "integrate zimbra with sympa.org"
** http://bugzilla.zimbra.com/show_bug.cgi?id=33712
* RFE - "Mail policies and access control for sending to distribution lists"
** http://bugzilla.zimbra.com/show_bug.cgi?id=9620


===Duplicate Emails With Distribution Lists===
===Duplicate Emails With Distribution Lists===
'''Note - this has nothing to do with hard links on the filesystem.'''
Situation arises when a message goes out and the effected user is somehow targeted twice in the To/CC fields by either use of a DL list, multiple DL lists, and/or a direct inclusion of their email address as well.


There was a change between 4.5.x and 5.x . New variable is zimbraMessageIdDedupeCacheSize.
There was a change between 4.5.x and 5.x . New variable is zimbraMessageIdDedupeCacheSize.


The "zimbraMessageIdDedupeCacheSize" attribute might be set to zero.
Setting the  "zimbraMessageIdDedupeCacheSize" attribute to zero disables this feature.


  su - zimbra
  su - zimbra
Line 68: Line 214:
* http://bugzilla.zimbra.com/show_bug.cgi?id=29371
* http://bugzilla.zimbra.com/show_bug.cgi?id=29371
* http://bugzilla.zimbra.com/show_bug.cgi?id=12072
* http://bugzilla.zimbra.com/show_bug.cgi?id=12072
In regards to DL messages sent  by the sender only being in their sent box:
* http://bugzilla.zimbra.com/show_bug.cgi?id=402
* http://bugzilla.zimbra.com/show_bug.cgi?id=402
** zimbraPrefDedupeMessagesSentToSelf vs. zimbraMessageIdDedupeCacheSize
===Confirming Hard Links With Message Blobs To DL On Filesystem===
Please see:
* https://wiki.zimbra.com/wiki/Ajcody-Backup-Restore-Issues#Easy_Way_To_SEE_Hard_Links_In_Use
----


[[Category: Community Sandbox]]
[[Category: Community Sandbox]]
[[Category: Author:Ajcody]]
[[Category: Zeta Alliance]]

Latest revision as of 19:24, 20 June 2016

Mailing Lists, Distribution Lists, And Mailman

   KB 2567        Last updated on 2016-06-20  




0.00
(0 votes)
24px ‎  - This is Zeta Alliance Certified Documentation. The content has been tested by the Community.


Actual Mailing Lists And Mailman Notes Homepage

Please see Ajcody-MailingLists-And-Mailman

Introduction And Choices - When Email Lists Have More Than 1000+ Recipients

If you are planning to use a distro list with 1000 to 3000 or more members, you should consider using a 3rd party mailing list software machine for this. This is the recommendation of the developers according the the bug/rfe's I reference below. According to bug 19153, you have 2 options:

  1. "set up mailing list manager or change the value of virtual_alias_expansion_limit as a customization. We have never tested with > 1000 so this should be done carefully, and will pound LDAP for any messages with lots of recipients."
  2. Mailman integration or another third party mailing list software package. There is a forum thread on how to integrate zcs and mailman. This would be the preferred fix to your issue, also noted in the bug report. We probably won't see Mailman integration in ZCS at least for another year or so, not until 6.0

Main Bug/RFE's to review:

  • "Problems resolving virtual aliases for members of large distribution lists"
    • https://bugzilla.zimbra.com/show_bug.cgi?id=19153
      • Note - this is marked as a duplicate of bug 8968, "Mailman Integration".
      • Comment 3 : "We have never tested with > 1000 so this should be done carefully, and will pound LDAP for any messages with lots of recipients."
        • Note - In ZCS 8, "Release notes: If dynamic lists are used, the default is to allow lists of up to 10,000 members. This can be controlled via the localconfig key postfix_virtual_alias_expansion_limit"
          • This does NOT resolve the issues for large email lists though, the recommendation is still to be using a dedicated mailing list software package.
      • Comment 5 : the answer for large lists is to use mailman. See bug 8968 and bug 21621
  • "Mailman Integration"
  • "Test and document manual mailman integration"


Other Bug/RFE's to review to see the full conversation on this from our developers - Note , it's important to note the bugs they are making duplicates of the main ones mentioned above.


References to Maining list software options:

Restricting Who Can Send To Mailing List

These are unsupport customizations. Please be sure to make backup copies of modifications to prevent lost after upgrades/restores of Zimbra.

Please see:


Also see the following RFE:

Restrict Sending To Certain Domains

Please see:

Add Everyone To Distribution List - Admin Console

RFE was made for this:

Everyone@domain Without Manually Adding Users To A DL

Investigating if this can be done. Please don't attempt anything below, I'm simply keeping track of my "notes" here.

DON'T ATTEMPT ANY OF THIS! THIS WILL MOST LIKELY GET POSTED INTO BUGZILLA AS AN RFE

RFE Made For This:

One Possible Way Described In An External Resource:

main.cf:
there is a line to resolve aliases:
virtual_aias_maps = ldap: $ config_directory / ldap / ldap-aliases.cf

ldap-aliases.cf
that relates to filter:
query_filter = (&(objectclass=mailgroup)(|(mail=%s)(mailalternateaddress=%s)))
result_attribute = mail result_attribute = mail
special_result_attribute = uniqueMember, memberUrl

in LDAP-e for everyone is recording with such attributes:
mail = everyone@domain.ru
memberurl = ldap :///ou=People,o=organization??sub? (&(objectclass=person)(uid=*))
objectclass=mailgroup
  • Had to use the following to get it to work:
receive_override_options = no_address_mappings 
Was a global setting.

Another Possible Way, again an external resource:

Problems Resolving Virtual Aliases For Members Of Large Distribution Lists

See the following bug:

Other wiki page is here - Error_(MTA):_unreasonable_virtual_alias_maps_map_expansion_size

The default expansion that will be done is for 1000 accounts.

Solution

Note, the bug above recommends NOT going over 1000 due to ldap performance. They recommend looking into mailman as an alternative.

Increase the virtual_alias_expansion_limit Postfix parameter to the value of the highest number of distribution list members. All commands run as the zimbra user.

Check configuration

$ postconf virtual_alias_expansion_limit

Set configuration

$ postconf -e virtual_alias_expansion_limit=3000

Restart Postfix

$ postfix stop
$ postfix start

Mailman - Mailing List Manager

Please see the following:

Sympa - Mailing List Manager

This might be another option to Mailman that might even be better.

https://www.sympa.org/overview/features

Someone made this comment on the zimbra-heid-admins@sfu.ca list :

"We recently switched from mailman to sympa, which does the same thing. Sympa allows membership data sources to be defined from SQL queries, ldap queries, and more. I'm very pleased with it."

Some customers are advocating for it over Mailman on this RFE:

Duplicate Emails With Distribution Lists

Note - this has nothing to do with hard links on the filesystem.

Situation arises when a message goes out and the effected user is somehow targeted twice in the To/CC fields by either use of a DL list, multiple DL lists, and/or a direct inclusion of their email address as well.

There was a change between 4.5.x and 5.x . New variable is zimbraMessageIdDedupeCacheSize.

Setting the "zimbraMessageIdDedupeCacheSize" attribute to zero disables this feature.

su - zimbra
zmprov gacf | grep zimbraMessageIdDedupeCacheSize

If you need to change the setting.

zmprov mcf zimbraMessageIdDedupeCacheSize 3000
zmmailboxdctl restart

Related Bugs:

In regards to DL messages sent by the sender only being in their sent box:

Confirming Hard Links With Message Blobs To DL On Filesystem

Please see:


Jump to: navigation, search