3918 Commits

Author SHA1 Message Date
Peter Serwylo
efdf328fd3 Clarify a limitation in the current implementation
Two repositories can (and always could) end up with the same exact .apk file.
If that .apk is the "suggested version", then we should eliminate the idea of
"suggested version code" and instead have a "suggested apk" (which implicitly
includes the repository it comes from, so we choose the one with the better
priority). Right now, we kind of assume that it doesn't matter which repo
provides the suggested apk, as long as one of them has an .apk with the correct
version code and signing key.

It shouldn't _particularly_ matter from a security perspective, because
a malicious repo wont be able to trick a user into installing an apk with a
different signing key, but it would be good to iron this out.

This commit adds a TODO explaining this for th ebenefit of any CRer.
2016-10-06 03:03:02 +11:00
Peter Serwylo
3ec64d6d82 Finalise tests for repo priorities + app metadata 2016-10-06 03:03:02 +11:00
Peter Serwylo
1d1c1ebb74 Add test for repo priorities + app metadata. Not passing yet. 2016-10-06 03:03:02 +11:00
Peter Serwylo
e25d26aca0 Moved tests into updater package, updated multiRepo.*.jar repos.
The tests are in the .updater packate to make them easier to run as
a suite in Android Studio. Now the package can be right clicked and
ran to run all the tests to do with updating.

The index jar files were updated so as to include info in most
metadata fields (e.g. URLs/descriptions/summary/etc) to show that
that particular part of metadata came from a specific repo. This
will allow more specific tests to show that we can indeed query for
an app with metadata provided by the repo with the highest priority.
2016-10-06 03:03:02 +11:00
Peter Serwylo
6d2fdb2843 Enable multirepo tests, make them pass.
Tests were failing because the repository of existing and new apks were not
considered when deciding whether to update or insert them.
2016-10-06 03:02:58 +11:00
Peter Serwylo
8ed884887a WIP: Making metadata table work. Requires significant refactorings throughout :( 2016-10-06 03:01:07 +11:00
Peter Serwylo
44a82c4af7 Migrate priorities safely. 2016-10-06 02:50:22 +11:00
Peter Serwylo
5efa53b466 Added package table.
Required for future work which will be better able to deal with multiple repos
providing the same app.
Instead of migrating data into that table, we will drop and recreate the tables.
This is because before this feature is out, we'll need to do that anyway.
db-version/63
2016-10-06 02:06:51 +11:00
Peter Serwylo
88c536efb4 Fix incorrect version check in db helper. 2016-10-05 23:54:28 +11:00
Peter Serwylo
486e8e699f Cleanup DBHelper in prep for package table in the future. 2016-10-05 23:54:28 +11:00
Peter Serwylo
45f9379fee Added helper function for debugging SQL queries during development
It is often helpful during debugging to be able to dump the contents
of an SQL result `Cursor` to the debug watch list. This is difficult
to do under normal circumstances. This adds a utility method really
only designed to be used during interactive debugging, which will do
its best to build a `Map` for each row in the `Cursor`. This can then
be used to test queries while the debugger is paused.
2016-10-05 23:54:28 +11:00
Peter Serwylo
97cf69341a When inserting a new repo, assign the priority appropriately.
Even though this is not used yet, it will be a requirement in the
near future for the `RepoProvider` to be the one who decides what
the priority of new repositories is. This will prevent clients of
this provider from specifying wrong priorities that result in gaps
For example, if we accidentally ended up with  priorities of
1, 2, 4, and then 5, this would cause problems if the user tried to
drag the second repo to the position of the 4th repo. It is easier
to do these priority shuffles if we can assume that the priorities
are contiguous.
2016-10-05 23:54:28 +11:00
Peter Serwylo
6c462713aa Renamed generic sounding methods to be more specific.
Originally, I hoped that the arguments a method took would help enough
to differentiate the intent of that method. This was the case for methods
such as `getContentUri()` and `find()`. However they are a little confusing
to work with, so this change renames a bunch of methods to be more specific.
In addition, it makes some renames from app -> package which will help with
the upcoming change to add a `package` table to the database.
2016-10-05 23:54:25 +11:00
F-Droid Translatebot
c8182d9c01 Pull translation updates from Weblate
Translators:

Adrià García-Alzórriz    Catalan
Ajeje Brazorf            Sardinian
Alberto Moshpirit        Spanish
Koen Glotzbach           Dutch
Licaon Kter              Romanian
Marcelo Santana          Portuguese (Brazil)
naofum                   Japanese
Nathan Follens           Dutch
Nutchanon Wetchasit      Thai
Osoitz                   Basque
Sérgio Marques           Portuguese (Portugal)
Sveinn í Felli           Icelandic
Sylvia van Os            Dutch
Verdulo                  Esperanto
Verdulo                  Polish
YFdyh000                 Simplified Chinese
2016-10-03 10:10:14 +01:00
Peter Serwylo
d35c84b2e1 Merge branch 'install-history' into 'master'
optionally keep install history

This adds the functionality for keeping the install/uninstall history along with a preference to enable it as a custom build option for allowing another app to read it.  Keeping the history has many uses, including:

* "popularity contest"
* displaying install history locally in F-Droid
* reporting to IT device manager for tracking activity for malware, etc.

This is ready to be merged, but it is based on !386, so its marked WIP.

@dschuermann this touches some of your architecture, please review :)

See merge request !392
2016-09-30 01:42:10 +00:00
Hans-Christoph Steiner
372b28a71a Installer methods no longer need to accept Apk as an argument
Since e69a6d5a8f24e7745516001f58bee49e05f2ea9e, the Apk instance is
provided in the constructor and is available as a final instance variable.
No need to pass it around.  Thanks to @pserwylo for spotting this.
2016-09-29 13:58:33 +02:00
Hans-Christoph Steiner
79df0a1f9b show complete link command in debug logging
Its helpful when debugging if the complete command is printed,
without omitting the last element.
2016-09-29 12:09:50 +02:00
Hans-Christoph Steiner
d2291b2134 send Installer.ACTION_INSTALL_STARTED consistently
ACTION_INSTALL_STARTED was being sent twice per transaction with the
default installer. Also, it should be sent as the first step of the install
process.
2016-09-29 12:09:50 +02:00
Hans-Christoph Steiner
a08a32020a add preference to control storing install history
For now, this is disabled by default and hidden in the expert preferences
since it doesn't do anything yet inside of F-Droid.  It is useful now for
whitelabel builds to fetch the install history from another app. #396
2016-09-29 12:09:50 +02:00
Hans-Christoph Steiner
f102ccff60 allow install history to be read from an ContentProvider
This allows a designated app to read the install history from F-Droid via a
ContentProvider.  The app is designated by the packageName defined in the
string install_history_reader_packageName.
2016-09-29 12:09:50 +02:00
Hans-Christoph Steiner
c02125db01 store install/uninstall history for later use
The install and uninstall history has lots of uses, including displaying
to the user in the app itself, reporting to the Device Administrator to
enable tracking of installs/uninstalls from the admin's app repo, etc.  It
can also be used as part of a "popularity contest" #396
2016-09-29 12:09:50 +02:00
Hans-Christoph Steiner
cb4edbed44 if updating notification, also try getting app name from DB
Now that the packageName is included in the Installer broadcast Intents,
it can be used to fetch the app name from the database, if all other ways
fail.
2016-09-29 12:09:50 +02:00
Hans-Christoph Steiner
e69a6d5a8f store Apk instance in Installer instance for fetching state
If F-Droid or InstallManagerService get killed while an install is in
progress, that install will ultimately broadcast back to
InstallManagerService to manage the notifications.  The state is gone
since things have been killed, so include the Apk instance in the
Intent that is included in the broadcasts so that
InstallManagerService can fetch all required info from the database.

closes #698
2016-09-29 10:59:16 +02:00
Hans-Christoph Steiner
fc5c41036d Merge branch 'gradle-updates' into 'master'
Gradle updates



See merge request !399
2016-09-29 08:46:16 +00:00
Daniel Martí
723be967ca Merge branch 'push-install-uninstall-requetss' into 'master'
Push requests for install/uninstall

This is the first basic implementation of the idea of "push requests" from the server.  This implements two requests that the server can ask of all clients: `install` and `uninstall`.  A default repository in the client can be marked to `ignore` or `always` accept push requests in this merge request.  There is also the sketch of a third option called `prompt` which gives the user the standard "Just Once/Always" choice; that is not yet implemented.

This allows central management of app installs/uninstalls for a pool of devices, as well as other ideas.

A use case for this feature is documented here:
https://f-droid.org/wiki/page/Whitelabel_Builds

See merge request !386
2016-09-28 22:40:07 +00:00
Hans-Christoph Steiner
b90cf7386c prevent crashing if push requests include bad packageNames
F-Droid shouldn't crash if a push request includes a bad package name. This
just makes it silently ignore those push requests.  If its a debug build,
it will send a message to logcat.  I'm not sure this is best way to handle
this, but this is better than crashing the app.  This will make it harder
for repo operators to debug issues with push requests.
2016-09-28 23:36:11 +02:00
Hans-Christoph Steiner
5c9dd1a11e basic support for repo push requests, configed in default_repos
This allows whitelabel versions of apps to specify built-in app repos that
have push requests accepted by default.  This is useful for the case where
there is a central manager of the core apps that are installed.

https://gitlab.com/fdroid/fdroidserver/issues/177
db-version/62
2016-09-28 23:36:11 +02:00
Daniel Martí
6c0a72369c gradle: bump version in wrapper to 3.1
Also re-run `gradle wrapper` from 3.1 to update the scripts and jar.
2016-09-28 22:15:00 +01:00
Daniel Martí
36378acc7b gradle: bump plugin version to 2.2.0
Also update the dependency declarations since the current ones break
with the new plugin/gradle version.

https://stackoverflow.com/questions/39602587/could-not-get-unknown-property-assemblerelease-for-project
2016-09-28 21:58:27 +01:00
Hans-Christoph Steiner
d34a1285e8 convert default_repo.xml to more flexible format
This is a step towards supporting easy whitelabeling, using gradle flavors.
This allows the whitelabel version to set the default repos just by making
their own default_repos.xml in app/src/whitelabel/res/values.  That one
will then override the built-in F-Droid one.
2016-09-28 22:07:34 +02:00
Hans-Christoph Steiner
28198dddb4 rename default_repo.xml to default_repos.xml, there are many
Just to make it clear that there can be and are multiple repos configured
in the file.
2016-09-28 22:07:34 +02:00
Daniel Martí
ae78042bda Bump versionCode to 0.102-alpha0
This enables upgrading from 0.101 to master until alpha1 is out.
2016-09-28 20:44:26 +01:00
Daniel Martí
85a8a7d743 Sync changelog with 0.101, add 0.102 2016-09-28 20:42:56 +01:00
Daniel Martí
ba8c39d3a9 Merge branch 'include-crash-in-acra-subject' into 'master'
Include crash in ACRA subject

This makes it so the first chunk of the crash is put in email subject.  This also lays the foundation for other ACRA customizations.

This is ready to be merged, but it is based on !386, so its marked WIP.

See merge request !391
2016-09-28 14:34:56 +00:00
Hans-Christoph Steiner
9848db7680 move CrashReportActivity into new .acra package
This isolates all the ACRA stuff in its own package.
2016-09-28 14:23:34 +02:00
Hans-Christoph Steiner
f24c5b6ac7 custom ACRA sender to put stacktrace title in email Subject:
This should hopefully make it easier to sort through the emails.
2016-09-28 14:23:34 +02:00
Daniel Martí
a5746c03f3 Merge branch 'tls-1.2-support' into 'master'
TLS 1.2 support

At long last, there is a tested version of NetCipher that supports SNI.  This uses that release to enable good TLS support and Tor for all repos.  This moves the HTTP tests to the emulator, so that things are tested on the actual OS.

See merge request !398
2016-09-28 12:00:51 +00:00
Hans-Christoph Steiner
4c7322d917 throw in extra test URLs for HttpDownloaderTest
These are commented out so that the tests aren't brittle when they run on
the CI builds.  But are easy to uncomment when testing locally.
2016-09-28 11:35:57 +02:00
Hans-Christoph Steiner
4598a78bfd support TLS 1.2 on all repos
Update to the latest NetCipher, which now fully supports SNI, in order to
support TLS 1.2 on all supported platform levels.  Without this, a repo
that is TLS 1.2 only will be unusable on all but the most recent versions
of Android.

#431
2016-09-28 11:35:57 +02:00
Hans-Christoph Steiner
bad613fbc1 move HttpDownloaderTest to emulator, AndroidOS has oddities
There are oddities with the way that Android has implemented the network
stack, as compared to OpenJDK or Oracle JDK.  So running the tests on the
local JVM, i.e. Robolectric, will not provide good test coverage for real
world use cases.
2016-09-28 11:35:57 +02:00
Hans-Christoph Steiner
0433f0eba5 update changelog for 0.101 2016-09-28 11:34:24 +02:00
Hans-Christoph Steiner
2773db8304 Merge branch 'latest-support' into 'master'
update to latest support lib bugfix version: v24.2.1

include the bugfix version of the support libs we are using since this is the last test before a stable release.

See merge request !397
2016-09-28 09:23:12 +00:00
Hans-Christoph Steiner
dd134c50bc update to latest support lib bugfix version: v24.2.1 2016-09-27 22:59:17 +02:00
Hans-Christoph Steiner
5e549193f1 gitlab-ci: ensure the SDK is fully updated before running
This makes sure that the latest version of the core SDK components are
all current before running, which means that the builds will keep
working even when the docker image gets out of date. Then we can
finish the task we are working on before having to deal with updating
the docker image. Without that update line, we have to drop everything
and update the docker image when things are out of date.

Disk space and bandwidth is cheap, developer time is very scarce. We
should aim to keep the tests working as much as possible so that we
waste less developer time. Updating everytime only means it downloads
a little bit of XML each time, that's nothing compared to what gradle
downloads on every build.
2016-09-27 22:59:17 +02:00
Hans-Christoph Steiner
f0d9675b55 gitlab-ci: use before and after script for reused chunks
It also reduces redundancy by using before_script and after_script blocks.
2016-09-27 16:19:45 +02:00
Hans-Christoph Steiner
a3b6185942 gitlab-ci: reduce connected10 from error to warning
connected10 is still flaky since the emulator crashes a lot.  Marking it
for "allow_failure" will still show a warning, but it won't fail the build.
2016-09-27 14:28:12 +02:00
Daniel Martí
3aad107b51 Add Icelandic to the list of languages
Added to weblate in the last commit.
2016-09-27 13:15:03 +01:00
F-Droid Translatebot
a29d2eb4f9 Pull translation updates from Weblate
Translators:

Ajeje Brazorf       Sardinian
Enol P              Asturian
Marian Hanzel       Slovak
Michael Moroni      Italian
Mladen Pejaković    Serbian
Sérgio Marques      Portuguese (Portugal)
Sveinn í Felli      Icelandic
Дмитрий Михирев     Russian
2016-09-27 13:11:44 +01:00
Hans-Christoph Steiner
ab7602c407 Merge branch 'fix-763--multi-repo-brokenness' into 'master'
Fix 763  multi repo brokenness

I've put a comment [here](https://gitlab.com/fdroid/fdroidclient/issues/763#note_15032709) explaining the problem.

This includes (in order of commits):
* A test case to reproduce (see my comment [here](https://gitlab.com/fdroid/fdroidclient/issues/763#note_15954822) about whether I should rename this)
* A brittle fix
* A more robust fix

See merge request !394
2016-09-27 10:20:15 +00:00
Hans-Christoph Steiner
e18164acbb Merge branch 'patch-1' into 'master'
Fixed link to privileged extension



See merge request !396
2016-09-27 07:23:11 +00:00