Thursday, November 23, 2017

Bitnami Redmine Installation on Ubuntu 16.04

Bitnami Redmine Installation on Ubuntu 16.04

Using Bitnami Redmine, go to https://bitnami.com/stack/redmine to download the latest version of Redmine local installer for Linux.
Upload the binary to the server then run it as root
chmod +x bitnami-redmine-<version>-linux-x64-installer.run

./bitnami-redmine-<version>-linux-x64-installer.run

Made a symlink for easy access

ln -s /opt/redmine<version> /opt/redmine

Start/Stop Service

The native installer also includes a command-line script to start, stop and restart applications, named ctlscript.sh. This script can be found in the installation directory and accepts the options start, stop, restart, and status. To use it, log in to the server console and execute it following the examples below:
  • Call it without any service names to start all services:
    Note: Only use sudo if the stack was installed as root
    sudo installdir/ctlscript.sh start
    
  • Use it to restart a specific service only by passing the service name as argument - for example, mysql or apache:
    Note: Only use sudo if the stack was installed as root
    sudo installdir/ctlscript.sh restart mysql
    sudo installdir/ctlscript.sh restart apache
    
  • Obtain current status of all services:
    installdir/ctlscript.sh status
    
The list of available services varies depending on the required components for each application.

Email Fetching from Gmail

Install rake to provide /usr/bin/rake
sudo apt-get install rake
Crontab
*/2 5-22 * * * /opt/redmine/helpdeskEmailPoll.sh > /opt/redmine/helpdeskEmailPoll.log
File: /opt/redmine/helpdeskEmailPoll.sh
#!/bin/bash
source /opt/redmine/scripts/setenv.sh
cd /opt/redmine/apps/redmine/htdocs

RAILS_ENV="production" /usr/bin/rake redmine:email:receive_imap host=imap.gmail.com port=993 ssl=1 username=helpdesk@ssis.edu.vn password=h3lpdesk\! project=helpdesk unknown_user=create no_permission_check=1 no_account_notice=1
To check when the last time the cronjob to check the helpdesk email, go to /opt/redmine/helpdeskEmailPoll.log

Use a MySQL trigger to "fix" the Active Directory user auto-creation

A bit of a hack, but it gets the job done. Run this using the "/opt/redmine/mysql/bin/mysql -uroot -p" command line client:
delimiter //
CREATE TRIGGER `user_before_insert` BEFORE INSERT
ON `users`
FOR EACH ROW BEGIN
IF NEW.login like '%@ssis.edu.vn' THEN
SET NEW.login = replace(NEW.login,'@ssis.edu.vn','');
SET NEW.auth_source_id= (SELECT id from auth_sources where type="AuthSourceLdap" and name like "SSIS%" limit 1);
END IF;
END//

CREATE TRIGGER `user_before_update` BEFORE UPDATE
ON `users`
FOR EACH ROW BEGIN
IF NEW.login like '%@ssis.edu.vn' THEN
SET NEW.login = replace(NEW.login,'@ssis.edu.vn','');
SET NEW.auth_source_id= (SELECT id from auth_sources where type="AuthSourceLdap" and name like "SSIS%" limit 1);
END IF;
END//

CREATE TRIGGER `user_after_insert` AFTER INSERT
ON `users`
FOR EACH ROW BEGIN
IF NEW.auth_source_id='1' THEN
SET @groupid := (SELECT DISTINCT id from users where type="Group" and lastname="SSIS Users");
INSERT INTO groups_users (group_id, user_id) VALUES (@groupid, NEW.id);
END IF;
END//

delimiter ;

Accessing PhpMyAdmin On Linux And Mac OS X

To access the application using your Web browser, create an SSH tunnel, as described below.
  • Open a new terminal window on your local system (for example, using "Finder -> Applications -> Utilities -> Terminal" in Mac OS X or the Dash in Ubuntu).
  • You have two options to configure the SSH tunnel: connect to the server using a private key (recommended) or connect to the server using a SSH password. Follow the instructions below per each option:
    • Option 1: Connect to the server using a private key
      • Make sure that you have your SSH credentials (.pem key file) in hand.
      • Run the following command to configure the SSH tunnel. Remember to replace KEYFILE with the path to your private key and SERVER-IP with the public IP address or hostname of your server:
        ssh -N -L 8888:127.0.0.1:80 -i KEYFILE syad@srvr-uredmine.ssis.edu.vn
        
    • Option 2: Connect to the server using a SSH password
      • Run the following command, remembering to replace SERVER-IP with the public IP address or hostname of your server. Enter your SSH password when prompted.
        ssh -N -L 443:127.0.0.1:443 sysad@srvr-uredmine.ssis.edu.vn
        
NOTE: If successful, the above commands will create an SSH tunnel but will not display any output on the server console.
  • Access the phpMyAdmin console through the secure SSH tunnel you created, by browsing to https://127.0.0.1/phpmyadmin.
  • Log in to phpMyAdmin by using the following credentials:
    • Username: root
    • Password: application password

File Attachments

Every year, Redmine will create a new directory under /opt/redmine/apps/redmine/htdocs/files/<year> with the permission ownership of root.root.  We need to change it to daemon.daemon in order for our users to upload new files.  We need to keep in mind to perform this every year or write a cronjob to perform this task.

Tuesday, November 14, 2017

Redirect multiple domain with NGINX

Web server

(web.example.com):  /etc/nginx/sites-available/redirect
server {
listen 80;
server_name records.example.com summer.example.com helpdesk.example.com;
if ($host = 'records.example.com'){
return 301 http://docs.google.com/;
}
if ($host = 'summer.example.com'){
return 301 http://domainsomewhere.net;
}
if ($host = 'helpdesk.example.com'){
return 301 http://youtube.com/sdfasa;
}
}


ln -s /etc/nginx/sites-available/redirect /etc/nginx/sites-enabled/redirect
nginx -t
service nginx restart

DNS

DNS entry point to webserver (ie. records alias to web.example.com)

Thursday, November 2, 2017

Check website page load and trace route

Here are two very nice website page load check and trace route.  It also provide recommendations on how to improve the page's performance.

http://www.monitis.com/pageload/
https://tools.pingdom.com

Thursday, October 26, 2017

Output Result from df Command STDOUT to HTML

An example of where we need this is to display the output from the command df to a webpage. All the spaces and newline are all disregarded by HTML so it will display as one long line.

PRE Block in HTML

Solution: Wrap output such as this in a pre block in HTML.
STORAGE=$(df -PTh | column -t | sort -n -k6n)
echo "<pre>$STORAGE</pre>"
Though, HTML does not take care of preserving white space

To preserve the white space

In the output of the command chain is white space in the form of spaces and newlines (and you are lucky there are no tabs). You should make pipe the output into | sed 's/ /&nbsp;/g' | sed 's/^/<br>/':
STORAGE=$(df -PTh | column -t | sort -n -k6n)| sed 's/ /&nbsp;/g' | sed 's/^/<br>/'
to preserve whitespace. You can use that without getting the font changing effect that <pre>induces.

HTML Table Format

$ printf "<pre>%s</pre>\n" "$storage" >> file.html
There should be no need to include column. This is a candidate for a HTML table, and could be begotten by something like:df -PTh | \
sed '1d' | \ sort -n -k6 | \ awk ' { printf "\n\t<tr>"; for (n = 1; n < 7; ++n) printf("\n\t<td>%s</td>",$n); printf "\n\t<td>"; for(;n <= NF; ++n) printf("%s ",$n); printf "</td>\n\t</tr>" } '
Wrap it in something like:
<!DOCTYPE html>
<html>
<head>
<meta charset="UTF-8">
<title>Disk space usage</title>
<style>
table, td, th {
  border : 1px solid green;
}
th {
  background-color: green;
  color : white;
}
</style>
</head><body>
<table>
  <tr>
    <th>Filesystem</th>
    <th>Type</th>
    <th>Size</th>
    <th>Used</th>
    <th>Avail</th>
    <th>Use%</th>
    <th>Mounted on</th>
  </tr>
  <!-- df output awk table -->
  <?php include('file.html'); ?>
</table>
</body>
</html>

Tuesday, October 24, 2017

Disable/Delete Inactive AD Users

Export to CSV file of Inactive users of over 90 days

Dsquery user "OU=Faculty Staff, OU=All Users,DC=SSIS,DC=EDU,DC=VN" –inactive 90  > inactiveUsers.csv

alternately

Locate Inactive Accounts 

Use Powershell run as Administrator
To find users that have not logged into the system and have not reset password for the last 90 days:
$90Days = (get-date).adddays(-90)
Get-ADUser -SearchBase "OU=Faculty Staff, OU=All Users,DC=SSIS,DC=EDU,DC=VN" -filter {(lastlogondate -notlike "*" -OR lastlogondate -le $90days) -AND (passwordlastset -le $90days) -AND (enabled -eq $True)} -Properties lastlogondate, passwordlastset | Select-Object name, lastlogondate, passwordlastset| export-csv inactiveUsers.csv –notypeinformation

Disable the Inactive Accounts

This will update the description [with a date to help determine the deleted date] and disable the account with using the PassThru switch:

Get-ADUser -SearchBase "OU=Faculty Staff, OU=All Users,DC=SSIS,DC=EDU,DC=VN" -filter {lastlogondate -le $90days -AND passwordlastset -le $90days} -Properties lastlogondate, passwordlastset | set-aduser -Description ((get-date).toshortdatestring()) –passthru | Disable-ADAccount

Delete Inactive Accounts

Now that we have all the accounts disabled, we need to delete them. We can use the Remove-ADObject cmdlet to delete the account, and then use Get-ADUser to read the Description attribute. To compare the date that the account was disabled to the current date, we can use Where-Object, as shown here:

$14days = (get-date).adddays(-14)
Get-Aduser -SearchBase "OU=Faculty Staff, OU=All Users,DC=SSIS,DC=EDU,DC=VN" -Filter {enabled -eq $False} -properties description | Where { (get-date $_.Description) -le $14Days} | remove-adobject

The command sed will prompt for every user before deleting the accounts. To get a list, you can use WhatIf, or if you do not want to get prompted, you can use Confirm:$False, as shown here:

Get-Aduser -SearchBase "OU=Faculty Staff, OU=All Users,DC=SSIS,DC=EDU,DC=VN" -Filter {enabled -eq $False} -properties description | Where { (get-date $_.Description) -le $14Days} | remove-adobject –whatif

Get-Aduser -SearchBase "OU=Faculty Staff, OU=All Users,DC=SSIS,DC=EDU,DC=VN" -Filter {enabled -eq $False} -properties description | Where { (get-date $_.Description) -le $14Days} | remove-adobject –confirm:$False

All-in-One Script

#import the ActiveDirectory Module
Import-Module ActiveDirectory
#Create a variable for the date stamp in the log file
$LogDate = get-date -f yyyyMMddhhmm
#Sets the OU to do the base search for all user accounts, change for your env.
$SearchBase = "OU=Faculty Staff, OU=All Users,DC=SSIS,DC=EDU,DC=VN"
#Create an empty array for the log file
$LogArray = @()
#Sets the number of days to delete user accounts based on value in description field
$Disabledage = (get-date).adddays(-14)
#Sets the number of days to disable user accounts based on lastlogontimestamp and pwdlastset.
$PasswordAge = (Get-Date).adddays(-90)
#RegEx pattern to verify date format in user description field.
$RegEx = '^(0[1-9]|1[012])[- /.](0[1-9]|[12][0-9]|3[01])[- /.](20)\d\d$'
#Use ForEach to loop through all users with description date older than date set. Deletes the accounts and adds to log array.
ForEach ($DeletedUser in (Get-Aduser -searchbase $SearchBase -Filter {enabled -eq $False} -properties description ) ){
  #Verifies description field is in the correct date format by matching the regular expression from above to prevent errors with other disbaled users.
  If ($DeletedUser.Description -match $Regex){
    #Compares date in the description field to the DisabledAge set.
    If((get-date $DeletedUser.Description) -le $Disabledage){
      #Deletes the user object. This will prompt for each user. To suppress the prompt add "-confirm:$False". To log only add "-whatif".
      Remove-ADObject $DeletedUser
        #Create new object for logging
        $obj = New-Object PSObject
        $obj | Add-Member -MemberType NoteProperty -Name "Name" -Value $DeletedUser.name
        $obj | Add-Member -MemberType NoteProperty -Name "samAccountName" -Value $DeletedUser.samaccountname
        $obj | Add-Member -MemberType NoteProperty -Name "DistinguishedName" -Value $DeletedUser.DistinguishedName
        $obj | Add-Member -MemberType NoteProperty -Name "Status" -Value 'Deleted'
        #Adds object to the log array
        $LogArray += $obj
    }
  }
}
#Use ForEach to loop through all users with pwdlastset and lastlogontimestamp greater than date set. Also added users with no lastlogon date set. Disables the accounts and adds to log array.
ForEach ($DisabledUser in (Get-ADUser -searchbase $SearchBase -filter {((lastlogondate -notlike "*") -OR (lastlogondate -le $Passwordage)) -AND (passwordlastset -le $Passwordage) -AND (enabled -eq $True)} )) {
  #Sets the user objects description attribute to a date stamp. Example "11/13/2011"
  set-aduser $DisabledUser -Description ((get-date).toshortdatestring())
  #Disabled user object. To log only add "-whatif"
  Disable-ADAccount $DisabledUser
    #Create new object for logging
    $obj = New-Object PSObject
    $obj | Add-Member -MemberType NoteProperty -Name "Name" -Value $DisabledUser.name
    $obj | Add-Member -MemberType NoteProperty -Name "samAccountName" -Value $DisabledUser.samaccountname
    $obj | Add-Member -MemberType NoteProperty -Name "DistinguishedName" -Value $DisabledUser.DistinguishedName
    $obj | Add-Member -MemberType NoteProperty -Name "Status" -Value 'Disabled'
    #Adds object to the log array
    $LogArray += $obj
}
#Exports log array to CSV file in the temp directory with a date and time stamp in the file name.
$logArray | Export-Csv "C:\Temp\User_Report_$logDate.csv" -NoTypeInformation